search

mdawar / rq-exporter

Prometheus metrics exporter for Python RQ (Redis Queue).
MIT License
66 stars 29 forks source link

use of gauge #15

Closed rokroskar closed 3 years ago

rokroskar commented 3 years ago

Hi there, thanks for this nice project! I'm curious about how you configure your rq queues to get useful statistics out of the gauges. The finished jobs are by default automatically cleaned so eventually the gauge loses track of them - or do you not care about historical numbers but really about the current state? Naively I would expect the summary metrics to be more appropriate, but perhaps I have a different use-case in mind.

mdawar commented 3 years ago

Hi,

We simply get the data using the Queue and Worker classes from the rq package when a request is made to the exporter by Prometheus, this data is about the current status of the workers and queues, rq does not provide any historical data.

This data is stored and managed by Prometheus, you can configure the scrape interval and the storage retention time.

Check out the utils.py for the functions that fetch this data from rq.

I hope this helps.