Add 'The Internet' test image to the suite

ukwa / ukwa-heritrix

The UKWA Heritrix3 custom modules and Docker builder.

9 stars 7 forks source link

Add 'The Internet' test image to the suite #70

Open anjackson opened 2 years ago

anjackson commented 2 years ago

This test system "The Internet", simulates lots of interesting web site behaviours, and is intended to test systems like crawlers. This could be integrated into this crawl engine, and this could be extended to cover e.g. DIGEST authentication testing.