HTTP lookup source max retries

getindata / flink-http-connector

Http Connector for Apache Flink. Provides sources and sinks for Datastream , Table and SQL APIs.

Apache License 2.0

136 stars 39 forks source link

HTTP lookup source max retries #90

Open Raz0r opened 2 months ago

Raz0r commented 2 months ago

Description

Lookup queries are now retried in case of IOException up to gid.connector.http.source.lookup.max-retries with a delay of gid.connector.http.source.lookup.request.retry-timeout-ms between retries. The default values are 3 retries and 1 second delay.

Resolves https://github.com/getindata/flink-http-connector/issues/66

PR Checklist

[x] Tests added
[x] Changelog updated

Raz0r commented 2 months ago

Hey @davidradl thanks, didn't know about existing AsyncRetryStrategies, I will need some time to figure out how to use it correctly with making IOException bubble up.

davidradl commented 2 months ago

@Raz0r See https://github.com/getindata/flink-http-connector/pull/94. As part of introducing caching there is a max-retries option that can be used