Crawl fail on some pages

internetarchive / dweb-mirror

Offline Internet Archive project

https://www-dweb-mirror.dev.archive.org/

GNU Affero General Public License v3.0

261 stars 27 forks source link

Open mitra42 opened 4 years ago

mitra42 commented 4 years ago

Two problems here a) crawl is failing to get page b) its saying no errors