How to run on flink 1.14.5？

getindata / flink-http-connector

Http Connector for Apache Flink. Provides sources and sinks for Datastream , Table and SQL APIs.

Apache License 2.0

150 stars 43 forks source link

How to run on flink 1.14.5？ #18

Closed yh-rgb closed 1 year ago

yh-rgb commented 2 years ago

Is any idea to run on 1.14.5, is it possible to downgrade some of the used apis?

maver1ck commented 2 years ago

Hi @yh-rgb, We based our sink on Async Sink API, which was introduced in 1.15. https://cwiki.apache.org/confluence/display/FLINK/FLIP-171%3A+Async+Sink So unfortunately downgrade would need rewrite everything.

kristoffSC commented 1 year ago

In fact it is not possible to replicate some features of Http Sink on 1.14 - for example Sink Async support that is crucial for HTTP clients was added to Flink in 1.15 and its based on batching, where Flink call Sink API with collection of events to process. Those events were buffered by Flink - again not supported in 1.14 unless you would use window mechanism.

Also we don't want to use @Internal API of Flink.