Exponential back-off when receiving 429 errors

rdf-connect / ldes-client

The TREE/LDES client to replicate and synchronize LDESs: the RDF Connect processor

https://rdf-connect.github.io/ldes-client/

6 stars 2 forks source link

Closed pietercolpaert closed 3 months ago

pietercolpaert commented 3 months ago

Some HTTP servers will provide 429 error codes when the LDES client does too many HTTP requests to their liking.

Behavior now: the LDES client stops the entire process

Desired behavior: it should exponentially back-off and try again

Real test-case:

ldes-client https://www.marineregions.org/feed.ttl