search

apache / seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
https://seatunnel.apache.org/
Apache License 2.0
8.06k stars 1.83k forks source link

job在设置为流处理模式情况下，kafka-source不会根据group-offset进行自动消费， #7971

Closed sj15600520109 closed 1 week ago

sj15600520109 commented 2 weeks ago

Search before asking

Description

创建了一个job，设置为流处理模式，kafka-source设置为group-offset模式，首次会把当前topic里未消费的message进行消费，消费完成后，我通过生产者又生产了消息，但此时job状态一直为running状态，但不会消费消息了，是设置的问题吗？

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

Code of Conduct

sj15600520109 commented 2 weeks ago

在相同的conf文件下，我换成了2.3.7版本的环境就可以正常消费，2.3.8版本应该存在bug

liunaijie commented 2 weeks ago

在相同的conf文件下，我换成了2.3.7版本的环境就可以正常消费，2.3.8版本应该存在bug

Yes, 2.3.8 Kafka connector has some bug, This pr will fix it https://github.com/apache/seatunnel/pull/7871