search

ukwa / ukwa-heritrix

The UKWA Heritrix3 custom modules and Docker builder.
9 stars 7 forks source link

Check de-duplication does not reference warc/revisit records #11

Closed anjackson closed 5 years ago

anjackson commented 6 years ago

This point makes me realise I should check our OutbackCDXPersistLoadProcessor and OutbackCDXPersistStoreProcessor work as they should and always refer back to the original record.

anjackson commented 5 years ago

Checked and we're good!