open-telemetry / opentelemetry-collector-contrib

Contrib repository for the OpenTelemetry Collector
https://opentelemetry.io
Apache License 2.0
2.88k stars 2.26k forks source link

[reciever/kafkametrics] Add support for topic configurations and assigning cluster alias #34148

Closed RutvikS-crest closed 3 weeks ago

RutvikS-crest commented 1 month ago

Component(s)

receiver/kafkametrics

Is your feature request related to a problem? Please describe.

kafkametrics reciever only supports one topic metric.

We want to monitor multiple kafka clusters, It will be easier if there is an additional metric dimension for each cluster.

We want to monitor kafka's topic configurations like replication-factor, min-insync-relicas, log-retention settings etc. These metrics will help us monitor and standardise topic configurations across all of our clusters.

Describe the solution you'd like

I propose to support following metrics that can easily be fetched using sarama client.

Add an optional configuration field to assign cluster alias name.

receivers:
  kafkametrics:
    protocol_version: 2.0.0
    cluster_alias: kafka-ecom
    scrapers:
      - brokers
      - topics
      - consumers

Describe alternatives you've considered

No response

Additional context

No response

github-actions[bot] commented 1 month ago

Pinging code owners:

crobert-1 commented 3 weeks ago

Hello @RutvikS-crest, was this completed in https://github.com/open-telemetry/opentelemetry-collector-contrib/pull/34149, or is there more work to do here? If it's complete, we can close the issue.

RutvikS-crest commented 3 weeks ago

Hi @crobert-1, Let's close this issue, It's completed.