Open pranavmarla opened 4 years ago
I have Fluentd set up to forward logs to Kafka. In some of the Prometheus metrics for the buffers of those Kafka output plugins, I'm seeing negative values. Specifically, I'm seeing negative values for the following metrics:
fluentd_output_status_buffer_total_bytes
fluentd_output_status_buffer_stage_byte_size
Eg.
fluentd_output_status_buffer_total_bytes{worker_id="3",plugin_id="kafka_output",type="kafka2"} -7897834.0 fluentd_output_status_buffer_stage_byte_size{worker_id="3",plugin_id="kafka_output",type="kafka2"} -7897834.0
This appears to be the same issue as #55, open since 2018.
<source> @type prometheus port 24240 metrics_path /metrics aggregated_metrics_path /aggregated_metrics </source> <source> @type prometheus_output_monitor </source>
1.11.2
1.8.2
0.0.2
0.14.1
I am experiencing the same issue with fluentd 1.14.6 and fluent-plugin-prometheus 2.0.2
Details
I have Fluentd set up to forward logs to Kafka. In some of the Prometheus metrics for the buffers of those Kafka output plugins, I'm seeing negative values. Specifically, I'm seeing negative values for the following metrics:
fluentd_output_status_buffer_total_bytes
fluentd_output_status_buffer_stage_byte_size
Eg.
This appears to be the same issue as #55, open since 2018.
Prometheus Config
Env Info
1.11.2
1.8.2
0.0.2
0.14.1