SeptimusZhu / septimuszhu.github.io

https://septimuszhu.github.io
0 stars 0 forks source link

Flink Kafka consumer checkpoint机制 | Cien años de soledad #12

Open SeptimusZhu opened 5 years ago

SeptimusZhu commented 5 years ago

https://septimuszhu.github.io/2017/02/07/Flink_Kafka_consumer_checkpoint/

基于Apache Flink 1.3 1 概述 Flink中Kafka consumer算子是有状态的,Kafka offset就是该算子的状态。consumer算子深度集成了Flink checkpoint机制,保证了exactly-once(一条消息被处理一次,区别于at-least-once和at-most-once)。