search

openiomon / fos2graphite

A utility to query metrics from Brocade SAN switches and director and transfer them to graphite backend
GNU General Public License v3.0
10 stars 1 forks source link

Dashboards not working in Grafana. #7

Open larkinis opened 1 year ago

larkinis commented 1 year ago

Hello! Many charts don't work and don't show data in dashboards in Grafana. Uploaded dashboards according to the instructions from /opt/fos2graphite/dashboards/graphite/ folder in Grafana. Grafana version: v10.0.1, but tried on many versions 8.1.6 and 8.2.7. Still doesn't work. Could you fix them please? Screenshot_2 Screenshot_1

mamoep commented 1 year ago

Which data source are you using? Some of the panels are built with VictoriaMetrics MetricsQL specific functions which are not available in native Prometheus.

larkinis commented 1 year ago

Data is collected by graphite Screenshot_3

mamoep commented 1 year ago

Can you check if all the panels use the correct data source?

larkinis commented 1 year ago

Yes, everywhere in Dashboards datasource by default is Graphite. I checked.

mamoep commented 1 year ago

Do you get any errors in the query inspector?

larkinis commented 1 year ago

mamoep, No, i think, there are no errors in query inspector. Screenshot_4

These Dashboards for monitoring brocade work for you? Or you didn't tested them? :)

mamoep commented 1 year ago

I am sure they were working in the past. I must admit I didn’t use the Graphite Dashboards for quite some time because we migrated to VictoriaMetrics. Maybe some migration steps in recent Grafana versions are to blame here. I will see if I can get it working in Grafana 10 and come back to you.

larkinis commented 1 year ago

You can offer any working version of Grafana. Working Dashboards are important to us. Installing any version using docker and importing Dashboards is not difficult. :)

Also, most of the charts is deprecated. Such as: Graph(old), and Panel plugin not found: grafana-piechart-panel use in Brocade: Initiator / Target Details (Realtime) and Brocade: Port Status (Realtime) . Pleace fix it.

Might help you find the problem: When I remove the nonNegativeDerivative() function(in all charts), the data appears. What is this function? It does not work? Screenshot_5

mamoep commented 1 year ago

The function nonNegativeDerivative() is used to convert an ever increasing value to a rate over time. See the documentation: https://graphite.readthedocs.io/en/latest/functions.html#graphite.render.functions.nonNegativeDerivative

Can you check if your graphite api implementation does support this function? "perSecond" could also be used instead.

mamoep commented 1 year ago

I updated the Graphite Dashboards to get rid of the deprecated panels. You can fetch them from the repo, new release will follow later.