newrelic / newrelic-ruby-agent

New Relic RPM Ruby Agent
https://docs.newrelic.com/docs/apm/agents/ruby-agent/getting-started/introduction-new-relic-ruby/
Apache License 2.0
1.19k stars 599 forks source link

Instrument Kafka client calls made with rdkafka-ruby #1758

Open fallwith opened 1 year ago

fallwith commented 1 year ago

With ruby-kafka's deprecation, the rdkafka-ruby gem which wraps librdkafka is well positioned to be most likely approach a Rubyist would take to interface with Kafka. As a result, we ought to instrument rdkafka-ruby.

kaylareopelle commented 1 year ago

Do we know what gem NR's Ruby teams use/if they're planning to make the move?

kaylareopelle commented 1 year ago

The kafka agent spec may also be merged soon. I think it's very close, but may help us accelerate implementation.

fallwith commented 1 year ago

It looks like the gem itself plans to publish Active Support messages:

https://github.com/appsignal/rdkafka-ruby/issues/54

workato-integration[bot] commented 1 year ago

https://issues.newrelic.com/browse/NR-144712

kaylareopelle commented 5 months ago

https://github.com/karafka has support for AppSignal and DataDog/StatsD monitoring. https://github.com/zendesk/ruby-kafka?tab=readme-ov-file#instrumentation used ActiveSupport monitoring

We could also look at the tech talk on Kafka monitoring from Friday 2/23/2024