Implement lookup retry mechanism

getindata / flink-http-connector

Http Connector for Apache Flink. Provides sources and sinks for Datastream , Table and SQL APIs.

Apache License 2.0

160 stars 45 forks source link

Implement lookup retry mechanism #122

Open grzegorz8 opened 2 months ago

grzegorz8 commented 2 months ago

Currently, when HTTP request fails, Optional.empty() is returned. Instead, we should retry the request configurable number of times. In addition, we should distinguish retryable errors from non-retryable ones (e.g. 400 Bad Request vs 503 Service Unavailable).

Flink already provides org.apache.flink.table.connector.source.lookup.LookupOptions#MAX_RETRIES.