search

impresso / impresso-pycommons

Python module with bits of code (objects, functions) highly reusable within impresso.
http://impresso-pycommons.rtfd.io/
GNU Affero General Public License v3.0
3 stars 3 forks source link

[rebuild] handle `EndpointConnectionError` #21

Closed mromanello closed 5 years ago

mromanello commented 6 years ago

While reading from S3, it may happen to have a downtime, see e.g.

Exception: Could not connect to the endpoint URL: "https://os.zhdk.cloud.switch.ch/original-canonical-data?versions&prefix=GDL%2F1921%2F04%2F08%2Fa%2FGDL-1921-04-08-a-issue.json"

The rebuild function should handle that in the best way possible.

Yet, we do not know how often this happens.

mromanello commented 5 years ago

this cannot be reproduced, so I'm closing it