search

gbif / crawler

The crawling pieces - ws, cli, coordinator
Apache License 2.0
4 stars 3 forks source link

"crawl cleanup" command #40

Closed MattBlissett closed 1 year ago

MattBlissett commented 4 years ago

The cleanup command: 

java -cp ~/lib/crawler-cleanup.jar org.gbif.util.zookeeper.ZookeeperCleanupFromFile $tmp $gbifenv

(e.g. run from the ./recrawl script on a CLI machine) does not clean any failed ingestion state.

MattBlissett commented 1 year ago

No longer relevant as ingestion state isn't managed by the crawler.