internetarchive / dweb-mirror

Offline Internet Archive project
https://www-dweb-mirror.dev.archive.org/
GNU Affero General Public License v3.0
273 stars 31 forks source link

Crawl fail on some pages #325

Open mitra42 opened 4 years ago

mitra42 commented 4 years ago

Two problems here a) crawl is failing to get page b) its saying no errors