search

redpanda-data / kminion

KMinion is a feature-rich Prometheus exporter for Apache Kafka written in Go. It is lightweight and highly configurable so that it will meet your requirements.
MIT License
615 stars 123 forks source link

Expose Kafka retention.bytes and partitions Over Time in a new metric #234

Closed selsabil94 closed 7 months ago

selsabil94 commented 9 months ago

Currently, the kminion_kafka_topic_info metric provides valuable insights into Kafka topic information, but lacks a dedicated metric for tracking retention.bytes and number of partitions over time. This enhancement aims to expose the retention.bytes and partitions information as a standalone metric, providing a clear and detailed view of data retention bytes and partitions information. This additional metric will enhance monitoring capabilities and allow users to track the growth and patterns of retention bytes/partitions, facilitating better capacity planning and resource management

weeco commented 7 months ago

Closing this for now, see ref: https://github.com/redpanda-data/kminion/pull/235#issuecomment-1937059102

With a different design we may consider it, exposing topic configurations via prometheus metric is not an ideal usecase though. Would be interesting to learn why one wants to track the topic configuration values historically via Prometheus