hikhvar
commented
4 years ago Hello, I think you are searching for a MQTT to prometheus gateway. This exporter is intended as a blackbox exporter to check the general functionality of the MQTT broker. Similar to the blackbox_exporter. Think of it as a end2end test for the broker itself.
There are several MQTT to prometheus gateways reading messages from MQTT and convert them to prometheus metrics.
- https://github.com/hikhvar/mqtt2prometheus (shameless self promotion, I am the author of this)
- https://github.com/tg44/mqtt-prometheus-message-exporter
- https://github.com/inuits/mqttgateway
pmundt
arnisoph
We are presently looking at exposing various MQTT topics to Prometheus for monitoring, and rather than developing our own solution, are interested in extending what you have done with the mqtt_blackbox_exporter - especially as you have already done a lot of the heavy lifting with SSL / auth.
Rather than exposing a summary of the events on a certain topic, we would look to expose the data from the underlying topic directly. My initial thought on this is that we would add a 'topics' field under each probe in the YAML configuration and define both the topic and the type of reading, then use this to dynamically construct prometheus metrics under topic-namespaced labels using the defined metric type.
Our use case is to monitor thermal characteristics of heterogeneous accelerators in deployed Edge environments, which are presently exposed through a combination of Prometheus exporters (e.g. EdgeTPUs) and MQTT topics.
I wanted to check with you whether this would, in general, be something that you are open to before committing the resources to getting it done.