[ISSUE #63] Support rich initialization modes of RocketMQSource & Fix some bugs

apache / rocketmq-flink

RocketMQ integration for Apache Flink. This module includes the RocketMQ source and sink that allows a flink job to either write messages into a topic or read from topics in a flink job.

https://rocketmq.apache.org/

Apache License 2.0

139 stars 88 forks source link

[ISSUE #63] Support rich initialization modes of RocketMQSource & Fix some bugs #72

Open deemogsw opened 1 year ago

deemogsw commented 1 year ago

Support rich initialization modes of RocketMQSource Fix some bugs

deemogsw commented 1 year ago

[x] [bug]PartitionDiscoveryIntervalMs can't set to negative
[x] [bug]Idle source task can't be released automatic
[x] [bug]Offset didn't commit to broker in RockerMQSource in phase of checkpoint
[x] [bug]Records can't arrive to sink() in UNBOUNDESS mode
[x] [features]Commit offset immediately when checkpoint is disable
[x] [features]Support rich initialization modes
[x] [features]Metrics with new source
[x] [features]Boost for flink-sql-connector

deemogsw commented 1 year ago

As description in issue #69 ,branch of master has some bugs with pr #46 .So my branch still be dependent on common pull mode. I will complete the README.md with usage of sql-connector later. @lizhimins @SteNicholas Can you help me review the code?

GOODBOY008 commented 1 year ago

@deemogsw Thanks for your contributions! Can you rebase to last main branch.

deemogsw commented 1 year ago

@deemogsw Thanks for your contributions! Can you rebase to last main branch.

Main branch has bug in litepull consumer.I have mentioned in issue #69 .You can also have a try by running the latest cade

SteNicholas commented 1 year ago

@deemogsw, could you please resolve the conflicts firstly?