IgnoredAmbience / yahoo-group-archiver

Scrapes and archives a Yahoo groups email archives, photo galleries and file contents using the non-public API
MIT License
93 stars 46 forks source link

fix the bogus ~64 byte file bug, and make database and polls errors retry gracefully #118

Closed Lord-Nightmare closed 4 years ago

Lord-Nightmare commented 4 years ago

fix a few issues: 1. if a file downloaded from the files api is ~64 (60-68) bytes, it is likely a bogus file, and treat it as an error and retry (if it legitimately was ~64 bytes, it will get the file anyway after downloading it 'Retries' times); 2. if a database or poll fails to download, the script should retry and gracefully fail