Add an option to save a snapshot of downloaded fics to the internet archive. Programmatically saving a snapshot of a page can be achieved by GETting 'https://web.archive.org/save/' + the url to snapshot.
Considerations:
Properly save explicit works by adding 'view_adult=true' to the query string. Detecting when this is necessary may be difficult. One option is to include it in the query string of all saved works, but this is clumsy and may cause confusion.
The internet archive imposes a rate limit on saving snapshots. At last check I think this is five seconds between calls. This eliminates the option that I can just sneak the wayback calls in synchronously, because the timing won't line up.
Option a: do the wayback saving in a second step (scraping the urls from the log file - or create a dedicated file just for this purpose). This might involve either some code duplication or a refactor. Also, just kind of a clunky user experience.
Option b: use a queue. This is a cool idea and it would be nice to say I did it, but my previous attempts at it have been disasters. Also, it would interact oddly with the concept of stopping the download in the middle, which is an important feature.
Add an option to save a snapshot of downloaded fics to the internet archive. Programmatically saving a snapshot of a page can be achieved by GETting 'https://web.archive.org/save/' + the url to snapshot.
Considerations: