IgnoredAmbience / yahoo-group-archiver

Scrapes and archives a Yahoo groups email archives, photo galleries and file contents using the non-public API
MIT License
93 stars 45 forks source link

Improve reliability of download process #12

Closed philpem closed 5 years ago

philpem commented 5 years ago

Yahoo sometimes throws back HTTP errors. Retrying after a short delay will result in a successful download.

This PR implements the retry logic.

Some groups have the Databases function disabled or locked for admins only. The 403 Forbidden error check detects this outcome and skips the download process. The alternative is that we enter the loop with the json variable unassigned and crash with an exception.