Graylog2 / graylog2-server

Free and open log management
https://www.graylog.org
Other
7.35k stars 1.06k forks source link

Inputs that are not receiving any messages have metric that shows it is receiving messages #19826

Open drewmiranda-gl opened 3 months ago

drewmiranda-gl commented 3 months ago

I have 3 inputs that i sent test messages to. I have stopped the script that sends test messages, but the "1 minute average rate" still shows messages/second:

image

If i view messages for this input, i can see that messages stop when i expected them to, and there are no new messages being received on this input:

image

Expected Behavior

"1 minute average rate" on inputs page is accurate

Current Behavior

"1 minute average rate" is incorrect and shows inputs receiving messages when they are not receiving any messages

Possible Solution

Steps to Reproduce (for bugs)

  1. ?

Unsure how reproducible this is but happy to have a meeting to demonstrate

Context

Not that important, but ran across this while testing something.

Your Environment

thll commented 3 months ago

Is the rate slowly decreasing though? It's a moving average, so it's not expected to drop right to 0 when you stop the message flow.

drewmiranda-gl commented 2 months ago

Interesting, how long is it expected to show throughput for? I wasn't measuring the output via an exporter so I unfortunately don't have any good data on if the metric was steady, or decreasing. I can attempt to reproduce and measure using the metrics exporter and prometheus.