[BUG] Offset will be losted when the job has restarted from checkpoint

apache / rocketmq-flink

RocketMQ integration for Apache Flink. This module includes the RocketMQ source and sink that allows a flink job to either write messages into a topic or read from topics in a flink job.

https://rocketmq.apache.org/

Apache License 2.0

139 stars 88 forks source link

[BUG] Offset will be losted when the job has restarted from checkpoint #76

Closed deemogsw closed 1 year ago

deemogsw commented 1 year ago

initOffsetTableFromRestoredOffsets in RocketMQSourceFunction. If job restarts from checkpoint .The whole mqs would be set to each subtask's offsetTable. The following pic shows the bug.

I'm testing for this fixing.Please assignee this issue to me. @SteNicholas tks