HTTP lookup source max retries

getindata / flink-http-connector

Http Connector for Apache Flink. Provides sources and sinks for Datastream , Table and SQL APIs.

Apache License 2.0

160 stars 45 forks source link

HTTP lookup source max retries #90

Closed Raz0r closed 4 weeks ago

Raz0r commented 7 months ago

Description

Lookup queries are now retried in case of IOException up to gid.connector.http.source.lookup.max-retries with a delay of gid.connector.http.source.lookup.request.retry-timeout-ms between retries. The default values are 3 retries and 1 second delay.

Resolves https://github.com/getindata/flink-http-connector/issues/66

PR Checklist

[x] Tests added
[x] Changelog updated

Raz0r commented 6 months ago

Hey @davidradl thanks, didn't know about existing AsyncRetryStrategies, I will need some time to figure out how to use it correctly with making IOException bubble up.

davidradl commented 6 months ago

@Raz0r See https://github.com/getindata/flink-http-connector/pull/94. As part of introducing caching there is a max-retries option that can be used

Raz0r commented 4 weeks ago

Closing this in favor of https://github.com/getindata/flink-http-connector/pull/129 and https://github.com/getindata/flink-http-connector/pull/120