[Improvement] Use AO3 official downloads.

DreamCobbler / fiction-dl

A content downloader, capable of retrieving works of (fan)fiction from the web and saving them in a few common file formats.

GNU General Public License v3.0

46 stars 2 forks source link

[Improvement] Use AO3 official downloads. #4

Closed laundmo closed 3 years ago

laundmo commented 3 years ago

AO3 offers downloads in multiple formats, namely: AZW3, EPUB, MOBI, PDF, HTML Direct links to these are very easy to get: https://archiveofourown.org/downloads/<story_id>/a.<extension> (the a here can be any text, by default it is the stories name, but it does not matter)

This has the potential to simplify the downloading and reduce load on ao3 and potential 429 - Too Many Requests errors.

DreamCobbler commented 3 years ago

Thank you for the suggestion! I've implemented a variant of that in the newly released 1.6.0 - though instead of using the files provided by AO3 itself, fiction-dl now uses the single-page view of the story. Does the same thing, i.e. there's just one page-download per story, which both reduces the load on AO3 and vastly speeds up the download itself.