CPU charts blank on revision 28 with Grafana 9.2.2

[bleetube]

CPU graphs seem borked on rev28 for me. Both of my "CPU Basic" and "CPU" graphs are blank on revision 28 with Grafana 9.2.2. If I downgrade either Grafana to 9.1.0, or the dashboard to revision 27, the charts display data again. I think this is due to some new issue and not related to the old $__rate_interval problems. I've tried replacing with s/$__rate_interval/5m/ and they're still blank. Otherwise all other charts are showing data as expected. Since I'm working on an ansible playbook, I tried reproducing the issue on a couple different versions and two Ubuntu releases (different Ubuntu, Prometheus, and node_exporter versions made no difference).

Grafana	node-exporter-full	CPU charts
9.1.0	rev27	Perfect
9.2.2	rev27	Perfect
9.1.0	rev28	weird flat line
9.2.2	rev28	blank

[courtland]

I noticed this as well yesterday and thought I was losing my mind / had broken something strange. Turns out I had upgraded from Grafana 9.2.1 to 9.2.2. Downgrading to 9.2.1 fixed the problem. Seems like a regression in the 9.2.2 release?

[xelatirdan]

Please, follow my answer: https://github.com/grafana/grafana/issues/57690#issuecomment-1296787752

[mennozon]

Thanks @xelatirdan, now it shows the graph again.

I did notice the graph looks a little weird because it isn't scaling to max 100 (max now is 100 * nr cpus), a workaround for this is to change max to 'auto' instead of the default 100, the graph looks okay again but values are still multiplied with the number of CPU's.

[Z10N0110]

After doing some research on the dashboard, I made a pull request to fix this. Tested on grafana 9.2.3. Working perfectly.

109

[IanSmith123]

Thanks @xelatirdan, now it shows the graph again.

I did notice the graph looks a little weird because it isn't scaling to max 100 (max now is 100 * nr cpus), a workaround for this is to change max to 'auto' instead of the default 100, the graph looks okay again but values are still multiplied with the number of CPU's.

It works for me! Thank you very much.

[xelatirdan]

@Z10N0110 I've tested your pr on grafana 9.2.6 and it works fine for me.

[courtland]

The change to using irate in 6bcaee1194cc9b578d1753a0fc15a24b52d8fc44 fixed the issue for me as well. I believe the bug in Grafana itself prior to that change still exists.

[teamsmiley]

hi I still having this issue with Grafana 9.4.3

The funny thing is above 12 hours. I can see CPU graph

but I change it to under 12 hours I got this

I used use node_exporter 1.2.0 I upgrade to node_exporter 1.6.0 but still not showing a graph under 12 hours

any idea?

[teamsmiley]

i change my prometheus config, then it works now

#scrape_interval: 1m
scrape_interval: 30s

[rfmoz]

This was fixed on https://github.com/grafana/grafana/issues/57690#issuecomment-1329324668