i have a new question.
Is it possible to use the “Aditional header / settings” optin in the harvester setitngs to also grab meta description/ or meta title when harvesting urls?
And can i display it (the description) in the main window?
Why – in my experience it is MUCH easier to understand if a site is or is not relevant from URL AND meta description than from just url alone.
so, its way faster to filter out bad results.