RADAR-base / RADAR-REST-Connector

A Kafka Source connector to receive data from REST APIs and publish them to Kafka. It has an extended version to support FitBit APIs.
https://radar-base.org/
Apache License 2.0
4 stars 4 forks source link

Retry with backoff when requests are continously failing. #63

Open nivemaham opened 4 years ago

nivemaham commented 4 years ago

It is possible that the REST requests are continously failing for certain amount of time due to external causes. (such as server not reachable ). In this case, the FitBit connector continuously retries until the request is successful. This produces large amount of logs and temporary overload. To prevent this, we can implement the approach recommended by @blootsvoets