nodeos_block_num Prometheus metric is showing 0 when block producer is producing a block itself.
It generates false-positive alerts and renders Grafana charts unreadable. Non-producer nodes are not affected.
Expected behavior
Show real block number even if node is currently producing without flapping.
Screenshots
Left side - producer logs, right side is showing while true curl | grep nodeos_block_num
Specs / Additional context
OS - Ubuntu 22.04 LTS
RAM - 256 GB
CPU - AMD Ryzen Threadripper 7960X
heifner
commented
6 hours ago
Describe the bug
nodeos_block_numPrometheus metric is showing 0 when block producer is producing a block itself. It generates false-positive alerts and renders Grafana charts unreadable. Non-producer nodes are not affected.Expected behavior
Show real block number even if node is currently producing without flapping.
Screenshots
while true curl | grep nodeos_block_numSpecs / Additional context
OS - Ubuntu 22.04 LTS RAM - 256 GB CPU - AMD Ryzen Threadripper 7960X
We observe this issue starting from
it persists on current version