sul-dlss / searchworks_traject_indexer

indexing MARC, MODS, and more for SearchWorks
Other
6 stars 1 forks source link

ruby-kafka is end-of-life #737

Open cbeer opened 1 year ago

cbeer commented 1 year ago

This library is no longer actively developed and has been superseded by librdkafka via rdkafka-ruby bindings. While this library may still receive security patches and bug fixes, it is no longer recommended for production usage.

jcoyne commented 1 year ago

Racecar (built atop rdkafka-ruby) is a viable alternative if we don't mind ditching jruby. They are looking for a maintainer to work with jruby https://github.com/appsignal/rdkafka-ruby/issues/222

thatbudakguy commented 1 year ago

No longer using jruby so we're free to move to racecar; we are already using it over in purl-fetcher.

thatbudakguy commented 11 months ago

ruby-kafka gives us some nice things like statistics tracking which we use to trigger alerts if things aren't indexing right — can we replicate that using racecar?

mensfeld commented 9 months ago

ruby-kafka gives us some nice things like statistics tracking which we use to trigger alerts if things aren't indexing right — can we replicate that using racecar?

You can replicate this with Karafka (karafka and rdkafka-ruby maintainer here): https://karafka.io/docs/Monitoring-and-Logging/#usage-statistics-and-subscribing-to-statisticsemitted-event

jcoyne commented 9 months ago

Thanks for looking in @mensfeld!

mensfeld commented 9 months ago

Anytime :) ping me in case of any questions :wave: