search

WebCuratorTool / webcurator

The root of the webcurator tool project, containing all modules needed to run a fully functional webcurator tool.
Apache License 2.0
2 stars 1 forks source link

TI dirs in baseHarvestDirectory are (almost) never purged #74

Open hannakoppelaar opened 2 years ago

hannakoppelaar commented 2 years ago

They are only removed when a target instance is aborted, but not when it is finished. These directories contain profiles and seed lists that are only needed at the start of a Heritrix job, so they should be removed upon harvest completion.