openzim / gutenberg

Scraper for downloading the entire ebooks repository of project Gutenberg
https://download.kiwix.org/zim/gutenberg
GNU General Public License v3.0
126 stars 37 forks source link

Downloads from dante HTTP mirror are failing #187

Closed benoit74 closed 10 months ago

benoit74 commented 12 months ago

I'm trying to run the scrapper on my dev machine (like I did before) and I do not achieve to download any file, I always get 403 errors.

One sample URL: https://dante.pglaf.org/cache/epub/21287/pg21287.epub (which was working on the Zimfarm on 11th of June)

It also looks like the Zimfarm has experienced issues recently with this scrapper, last run has even been canceled because it took too long to complete : https://farm.openzim.org/pipeline/6ace2571-0dd9-43d8-bdd7-3a620890f787

@eshellman : do you have any hint of what might be going on? Thanks in advance!

eshellman commented 11 months ago

will check

eshellman commented 11 months ago

use aleph.pglaf.org dante is retired.