search

faust-streaming / faust

Python Stream Processing. A Faust fork
https://faust-streaming.github.io/faust/
Other
1.66k stars 183 forks source link

Agent does not iterate over the changelog topic #139

Open PJ-Schulz opened 3 years ago

PJ-Schulz commented 3 years ago

Hello,

I found this Issue from @xqzhou at the robinhood/faust project: https://github.com/robinhood/faust/issues/293

Steps to reproduce

Define an agent consume message from a table's changelog topic

Expected behavior

As table getting updated and message written into changelog topic, agent should receive the message

Actual behavior

Agent is not receiving the new changelog message

I still have this problem with faust-streaming. Is there an action to fix it so that the app does not pause active partitions when there is an agent subscribing to the table-changelog-topic?

wbarnha commented 1 year ago

Is there an action to fix it so that the app does not pause active partitions when there is an agent subscribing to the table-changelog-topic?

This is an old issue, but for anyone reading this, I suggest looking at https://github.com/robinhood/faust/issues/505#issuecomment-677829807. Unfortunately we do not have plans to implement that functionality ourselves at the moment.