jakipatryk
commented
1 year ago Release notes dao: A random (quadratically + linearly randomized) wait has been added between retries of the same URL and between switching URLs on calling the REST API
Closed benedeki closed 1 year ago
jakipatryk
commented
1 year ago Release notes dao: A random (quadratically + linearly randomized) wait has been added between retries of the same URL and between switching URLs on calling the REST API
Background
When a Rest-API calls fails from SparkJobs it is retried immediately, possibly creating an ingestion on the Rest endpoint.
Feature
In case of a failure & retry on Rest API call add a random length ~2 seconds sleep.