apache / rocketmq-flink

RocketMQ integration for Apache Flink. This module includes the RocketMQ source and sink that allows a flink job to either write messages into a topic or read from topics in a flink job.
https://rocketmq.apache.org/
Apache License 2.0
139 stars 88 forks source link

[BUG] some bug in newSource #103

Open 844028312 opened 7 months ago

844028312 commented 7 months ago

1.InnerConsumerImpl ,set OffsetsSelector.committedOffsets(),if offset=-1, and minoffset >-1 image set offset will thorw exception image

2.RocketMQSourceEnumerator a. this.pendingSplitAssignmentMap not remove ,when taskmanager restart , it will resend taskmanager and reset offset ,Repeated consumption b. addSplitsBack(List splits, int subtaskId),splits not handle

3.RocketMQSourceEnumStateSerializer deserializeMessageQueue bug

4.RocketMQSplitReader when wakeup Shouldn't pause Consumer,Will lead to no consumption