Add crawler ID to Kafka log output

ukwa / ukwa-heritrix

The UKWA Heritrix3 custom modules and Docker builder.

10 stars 7 forks source link

Open anjackson opened 3 years ago

anjackson commented 3 years ago

Add the crawler: 'Heritrix' tag/annotation to the crawl log output(s) so crawl log analysis can tell which crawl engine did what.