kafka-dev / kafka

A distributed publish/subscribe messaging service
http://sna-projects.com/kafka
Apache License 2.0
549 stars 300 forks source link

Kafka size per message #74

Open MariaAzucena88 opened 3 years ago

MariaAzucena88 commented 3 years ago

Hi all, we want to monitor the storage used in kafka broker per topic if possible per message, in order to do that we are creating some dashboards using grafana (influxdb and prometheus), but we want to me sure the metrics we are using are showing the right values so we want to validate if the storage bytes used per kafka message matches with the values displayed in the dashboards, do you know how to check how many storage bytes are used per message? I know there are some kafka wrappers that use extra bytes we would like to know if there is a way to know the total bytes used per message and the total storage used per topic, do you know if that's possible in kafka?