standardebooks / web

The source code for the Standard Ebooks website.
https://standardebooks.org
Creative Commons Zero v1.0 Universal
234 stars 61 forks source link

Replace GetEbooksFromFilesystem with a DB implementation #383

Closed colagrosso closed 1 month ago

colagrosso commented 1 month ago

Even though you said to leave bulk downloads till the very end, this small change to scripts/generate-bulk-downloads allows us to get rid of a fair bit of Library code. The script is still a beast to run, but it doesn't run any slower after getting the ebooks from the DB instead of the filesystem.

I won't work on any further changes to bulk downloads until the rest of the site is running well with the commits in this branch.

acabal commented 1 month ago

OK! I think the bulk of the time in that script is just zipping up many very large zip files.