search

centreon / centreon-broker

A full-featured monitoring event broker, compatible with MySQL, RRDtool, Graphite and more
Apache License 2.0
37 stars 15 forks source link

Centreon / Graphite Dropping Metrics #632

Closed RJSOG closed 2 years ago

RJSOG commented 2 years ago

Hi, i am a junior sys admin so please be comprehensive and kind ! I am building a monitoring infrastructure composed of :

I coded a python middleware beetween graphite and grafana allowing to execute sql queries on InfluxDB who is storing metrics status. My middleware is using graphite API to get the metrics, but 271metrics / 1,5K are ignored by the script because the value are set to "[ ]" or "None" ! I've tried to "play" with the "retentions" and the "xFilesFactor" parameters and resizing my metrics to fix the issue but he didn't worked !

So i have some questions :

Thanks a lot !

omercier commented 2 years ago

Hi,

Hi, i am a junior sys admin so please be comprehensive and kind ! I am building a monitoring infrastructure composed of :

  • Centreon v20.04 I encourage you to upgrade to a newer version in the next few months since 20.04 is reaching its end of support.

  • Graphite v1.2.0

  • Grafana v7.3.6

  • InfluxDB v1.8.3

I coded a python middleware beetween graphite and grafana allowing to execute sql queries on InfluxDB who is storing metrics status. My middleware is using graphite API to get the metrics, but 271metrics / 1,5K are ignored by the script because the value are set to "[ ]" or "None" ! I've tried to "play" with the "retentions" and the "xFilesFactor" parameters and resizing my metrics to fix the issue but he didn't worked !

Do you know what services (and what plugins) produce such metrics?

So i have some questions :

  • At what interval Centreon_broker is sending metrics to graphite ?

Are you using the Storage - Graphite output type? If so, there is no interval, broker sends the data in real-time.

  • Can the broker send "None" values to Graphite ?

According to this document we comply with the value is mandatory, so metrics without value should not be returned by the plugin.

  • What are the needed values in graphite parameters to not dropping centreon metrics ?

I am not sure I understand the question, maybe the answer is just above?

  • Can there be a link beetween all the metrics that graphite is dropping (in my case the 271 metrics are comming from the same poller)

This is probably a broker cache issue. Try restarting centengine on your poller and see if it fixes the issue.

Thanks a lot ! You're welcome! Regards