Consider retrying on certain HTTP response codes, i.e 429, 502, 503

buren / wayback_archiver

Ruby gem to send URLs to Wayback Machine

https://rubygems.org/gems/wayback_archiver

MIT License

57 stars 11 forks source link

Consider retrying on certain HTTP response codes, i.e 429, 502, 503 #22

Open buren opened 6 years ago

buren commented 6 years ago

In Request#perform_request

429 Too Many Requests   - Check HTTP header for date value, if its not too long in
                          the future wait until then, otherwise return
502 Bad Gateway         - Consider waiting a few seconds, or whatever is configured
503 Service Unavailable - Sames is for 502