search

osmcode / pyosmium

Python bindings for libosmium
https://osmcode.org/pyosmium
BSD 2-Clause "Simplified" License
317 stars 65 forks source link

Add download retry mechanism #236

Closed Firefishy closed 1 year ago

Firefishy commented 1 year ago

At the moment the diff server occasionally returns 500 or 503 HTTP errors which cause pyosmium to immediately fail.

The AWS recommends adding a retry mechanism with back-off.

It might be a good idea to add a retry mechanism for downloads.

(Separately I will follow up with AWS to try fix the occasional 5xx errors)

Firefishy commented 1 year ago

"It's a best practice to build retry logic into applications that make requests to Amazon S3." - AWS in reply to the 500 error. :-/

lonvia commented 1 year ago

Duplicate of #235.