Open spike-liu opened 2 years ago
@Nicole00 just finish research of FLIP-143: Unified Sink API and here is my thoughts:
First of all, there is no conflicts between existing implementation vis RichSourceFunction and new API mentioned above. And it is more like that new API provides an improved mechanism for developer to ensure Exactly-once semantics.
Secondly, I checked master branch of Flink, currently only Kafka/Kinesis/ElasticSearch/Pulsar implemented new API.
Thirdly, JDBC connector also support exactly-once semantics via old CheckpointedFunction/CheckpointListener API.
However JDBC SQL connector does not support exactly-once semantics:
But JDBC provides exactly-once semantics via JAVA api:
Hence it could be good for us to provide an option for user to having exactly-once semantics. Just like Kafka's implementation as below:
What is your idea, @Nicole00 ?
same title as #65 ?
same title as #65 ?
My mistake, have updated the title of #65
Thanks for your research @spike-liu . I believe it would be more flexible to give the user an option to have exactly-once semantics.
So I prefer to refactor the sink api. Mark this issue as feature req.
This could be an issues need to be refactor.
Spilt discuss from https://github.com/vesoft-inc/nebula-flink-connector/issues/38