Check how crawler handles Preview only books -

internetarchive / dweb-mirror

Offline Internet Archive project

https://www-dweb-mirror.dev.archive.org/

GNU Affero General Public License v3.0

261 stars 27 forks source link

Closed mitra42 closed 4 years ago

mitra42 commented 4 years ago

I think it should crawl the preview and store as expected (small scale, just a few) pages See #252 where fixed handling of urls from browser.

mitra42 commented 4 years ago

Looks like working