search

jay7x / rsyslog_exporter_py

Export rsyslog counters as prometheus metrics (python + omprog version)
Apache License 2.0
5 stars 11 forks source link

No data after a few minutes with rsyslog 8.2108.0 or more recents versions #2

Open mvrk69 opened 2 years ago

mvrk69 commented 2 years ago

Hi,

Seems with 8.2108.0 they did some change on impstats module and this exporter isn't working properly anymore.

If i open the endpoint on Prometheus i only see this:

# HELP python_info Python platform information # TYPE python_info gauge python_info{implementation="CPython",major="2",minor="7",patchlevel="5",version="2.7.5"} 1.0 # HELP process_virtual_memory_bytes Virtual memory size in bytes. # TYPE process_virtual_memory_bytes gauge process_virtual_memory_bytes 3.7169152e+08 # HELP process_resident_memory_bytes Resident memory size in bytes. # TYPE process_resident_memory_bytes gauge process_resident_memory_bytes 1.7321984e+07 # HELP process_start_time_seconds Start time of the process since unix epoch in seconds. # TYPE process_start_time_seconds gauge process_start_time_seconds 1.6527942203e+09 # HELP process_cpu_seconds_total Total user and system CPU time spent in seconds. # TYPE process_cpu_seconds_total counter process_cpu_seconds_total 2.37 # HELP process_open_fds Number of open file descriptors. # TYPE process_open_fds gauge process_open_fds 7.0 # HELP process_max_fds Maximum number of open file descriptors. # TYPE process_max_fds gauge process_max_fds 16384.0 # HELP rsyslog_exporter_collecting_seconds Time spent on collecting metrics # TYPE rsyslog_exporter_collecting_seconds summary rsyslog_exporter_collecting_seconds_count 51.0 rsyslog_exporter_collecting_seconds_sum 0.00018858909606933594 # TYPE rsyslog_exporter_collecting_seconds_created gauge rsyslog_exporter_collecting_seconds_created 1.652794221161721e+09 # HELP rsyslog_exporter_parsing_seconds Time spent on parsing input # TYPE rsyslog_exporter_parsing_seconds summary rsyslog_exporter_parsing_seconds_count 6348.0 rsyslog_exporter_parsing_seconds_sum 0.5183594226837158 # TYPE rsyslog_exporter_parsing_seconds_created gauge rsyslog_exporter_parsing_seconds_created 1.652794221161695e+09 # HELP rsyslog_exporter_version Version of rsyslog_exporter running # TYPE rsyslog_exporter_version gauge rsyslog_exporter_version{version="1.0"} 1.0 # HELP rsyslog_exporter_up Is rsyslog_exporter up and connected? # TYPE rsyslog_exporter_up gauge rsyslog_exporter_up 1.0 # HELP rsyslog_exporter_last_stats_processed Amount of rsyslog stats processed last time # TYPE rsyslog_exporter_last_stats_processed gauge rsyslog_exporter_last_stats_processed 68.0 # HELP rsyslog_exporter_parser_failures_total Amount of rsyslog stats parsing failures # TYPE rsyslog_exporter_parser_failures_total counter rsyslog_exporter_parser_failures_total 0.0 # HELP rsyslog_exporter_last_export_timestamp Last metrics export timestamp # TYPE rsyslog_exporter_last_export_timestamp gauge rsyslog_exporter_last_export_timestamp 1.652795131903094e+09

Any idea on how to fix it?

jay7x commented 2 years ago

Hi! Thank you for your report.. I'll try to check it this weekend!

mvrk69 commented 2 years ago

I have my impstats interval at 10s, if i change it to 60s seems to work a bit better, but still from time to time looses data for almost 2h.

I have another server running rsyslog 8.2106 without any problem, so seems the problem started with 8.2108

Attaching my config. impstats.conf.txt

And the prometheus graphics when i changed the interval to 60s. prom_rsyslog_interval60