flipp-oss / deimos

Framework to work with Kafka, Avro and ActiveRecord
Other
59 stars 22 forks source link

Use Datadog APM for Kafka #82

Closed dorner closed 1 month ago

dorner commented 3 years ago

As of version 0.38, ddtrace-rb supports ruby-kafka out of the box: https://github.com/DataDog/dd-trace-rb/pull/1070

We should look at the existing DD metrics / tracing to see if it makes sense for us to just use the existing ruby-kafka integration or if we should keep our custom things. The integration is a bit chatty so we might need to do some filtering first: https://github.com/DataDog/dd-trace-rb/blob/master/docs/GettingStarted.md#processing-pipeline

The other thing to think about is that we have configurable backends, and we might need a way to suppress particular metrics/tracing for Kafka but allow it for other things.

dorner commented 1 month ago

No longer relevant in v2.