search

danielqsj / kafka_exporter

Kafka exporter for Prometheus
Apache License 2.0
2.1k stars 602 forks source link

Minimun and desired resources for kafka-exporter version 1.4.2 #305

Open sierrcal opened 2 years ago

sierrcal commented 2 years ago

Hello,

We upgraded to kafka-exporter v 1.4.2 but we are suffering an issue regarding performance. We are running kafka-exporter as a container using docker in aws. The issue we are facing is OOM. (recurrently)

` dmesg | grep -i kill

[2565215.920123] Out of memory: Kill process 4750 (kafka_exporter) score 879 or sacrifice child [2565215.935072] Killed process 4750 (kafka_exporter) total-vm:7186464kB, anon-rss:7170700kB, file-rss:0kB, shmem-rss:0kB [2565219.382329] oom_reaper: reaped process 4750 (kafka_exporter), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB`

We would like to know what's the minimun and desired resources for kafka-exporter version 1.4.2.

Thanks in advance. Cheers,

andyast commented 2 years ago

Last 45ish minutes it's hovered around 75MB for us. This is running as a standalone deployment in k8s.
image

Here is the output of top Mem: 11829684K used, 4201148K free, 6840K shrd, 57060K buff, 6047256K cached CPU: 5.2% usr 0.4% sys 0.0% nic 94.1% idle 0.0% io 0.0% irq 0.1% sirq Load average: 0.84 0.57 0.45 2/889 26