search

fluent / fluent-plugin-prometheus

A fluent plugin that collects metrics and exposes for Prometheus.
Apache License 2.0
257 stars 80 forks source link

prometheus_tail_monitor does not refresh deleted/rotated files. #189

Open SarthakSahu opened 3 years ago

SarthakSahu commented 3 years ago

We are using tail plugin with "pos_file_compaction_interval" option. With this option pos_file is getting updated by removing all deleted tailed file information. We are using the prometheus_tail_monitor plugin to get the information of tailed files.

Issue: When the tailed files are getting deleted/rotated, even though the pos_file is updated, But metrics fluentd_tail_file_inode and fluentd_tail_file_position are not updated and still shows the information of deleted/rotated files. As a result of this the amount of data exposed by these metrics are increasing continuously.

Found a similar discussion in google groups. https://groups.google.com/g/fluentd/c/KsoAoTp62dA

archupriya3 commented 1 year ago

Any update on this issue?

aggarwalShivani commented 1 year ago

Hi, I am facing the same issue with td-agent-4.3.1-1.el8.x86_64 (fluent-plugin-prometheus-2.0.2, prometheus-client-2.1.0). Any updates on fixing this?

archupriya3 commented 1 year ago

Any updates on this issue? We are facing the same issue with 4.4.2 td-agent rpm as well.

moharana-subhashree commented 11 months ago

Any updates on this issue? We are facing the same issue with 4.5.0 td-agent rpm.

moharana-subhashree commented 5 months ago

Any updates on this issue? We are facing the same issue with fluent-package-5.0.2-1 rpm.