RocketMQ integration for Apache Flink. This module includes the RocketMQ source and sink that allows a flink job to either write messages into a topic or read from topics in a flink job.
By default, the rocketmq-flink jar file contains too many unnecessary dependencies (flink-core/flink-runtime/flink-client/flink-avro/flink-streaming-java/powermock/logback ......)that can easily lead to dependency conflicts.
In the default connector module, we should not perform shading, and we should introduce a separate SQL module for shading the required dependencies. We need to relocate the shaded jar files to avoid conflicts.
lizhimins
commented
9 months ago
By default, the rocketmq-flink jar file contains too many unnecessary dependencies (flink-core/flink-runtime/flink-client/flink-avro/flink-streaming-java/powermock/logback ......)that can easily lead to dependency conflicts.
In the default connector module, we should not perform shading, and we should introduce a separate SQL module for shading the required dependencies. We need to relocate the shaded jar files to avoid conflicts.