danihodovic / celery-exporter

A Prometheus exporter for Celery metrics
MIT License
377 stars 83 forks source link

Memory occupation grows over time #263

Open CharlesB2 opened 11 months ago

CharlesB2 commented 11 months ago

Hello, We deploy celery-exporter on a kubernetes cluster using the public docker image (tag 0.7.5), but we get memory usage slowly increasing so that after weeeks it reaches over 1 GB, while it started under 100 MB image

adinhodovic commented 11 months ago

v0.8.0 and above cleanup metrics of timed out / rotated workers. It might be that an exporter running longer time in environments with high cardinality on worker names (e.g pod names) cause more metrics/memory usage. Try and see, it will cleanup metrics of workers that have timed out longer than 5 minutes.