search

ControlSystemStudio / phoebus

A framework and set of tools to monitor and operate large scale control systems, such as the ones in the accelerator community.
http://phoebus.org/
Eclipse Public License 1.0
83 stars 86 forks source link

Upgrade to Kafka 2.8 ( or 3.4?) #2672

Open shroffk opened 1 year ago

shroffk commented 1 year ago

There have been recent improvements in kafka which improve error handling in streams. The two changes which might be particularly useful are the improvements in how to handle timeouts and handling streams which enter error state

https://cwiki.apache.org/confluence/display/KAFKA/KIP-572%3A+Improve+timeouts+and+retries+in+Kafka+Streams

https://cwiki.apache.org/confluence/display/KAFKA/KIP-671%3A+Introduce+Kafka+Streams+Specific+Uncaught+Exception+Handler

georgweiss commented 1 year ago

Thanks @shroffk.

tsgit commented 1 year ago

yes, please update to kafka 3.4

currently cmd logging isn't working properly with phoebus alarm logger and kafka 3.4 the logger doesn't create the necessary consumers for both the message and cmd stream groups. it's one or the other

smarsching commented 21 hours ago

I think this has been addressed with #2953 and should be closed, right?