What does the error status in URL queue mean?

ArchiveTeam / grab-site

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

Other

1.35k stars 134 forks source link

What does the error status in URL queue mean? #160

Open Phasip opened 5 years ago

Phasip commented 5 years ago

I got a few connection errors due to an unstable uplink, I find that the failed urls can be found using gs-dump-urls DIR/wpull.db error Does this mean that grab-site has given up on said url or that it has failed once and will be retried?