nianeyna / ao3downloader

Utility for downloading fanfiction in bulk from the Archive of Our Own
GNU General Public License v3.0
178 stars 16 forks source link

Add timeouts #119

Closed prichmp closed 8 months ago

prichmp commented 8 months ago

There's a case where Cloudflare holds a HTTP connection open indefinitely while the AO3 server itself fails to actually send a response.

This adds timeouts so that when that happens, we can at least move on to the next work.

Example URL with this behavior: https://download.archiveofourown.org/downloads/25930015/Welcome_to_the_Worlds.azw3?updated_at=1688946022