search

ncabatoff / process-exporter

Prometheus exporter that mines /proc to report on selected processes
MIT License
1.67k stars 265 forks source link

namedprocess_namegroup_num_procs doesn't refresh when the process is up again #305

Open shakenfr opened 2 months ago

shakenfr commented 2 months ago

Hello,

I have for exemple this promql code in prometheus alertmanager

(namedprocess_namegroup_num_procs{job='exporter-sd-process-exporter',groupname="kube-scheduler"}) == 1

when my process is lost or kill, it gives a value to 0 and alert (it's normal)

when the process is up again, the value remains 0 instead of 1 and the alarm remains until I restart process_explorer. ( not normal)

Is is possible that the process explorer refreshs without restart it ?

best bruno

blissend commented 2 months ago

Exactly what I'm trying to figure out. Doesn't look like process-exporter has a builtin way to rescan the /proc

EDIT: I stand corrected...

-recheck (default:false) means that on each scrape the process names are re-evaluated. This is disabled by default as an optimization, but since processes can choose to change their names, this may result in a process falling into the wrong group if we happen to see it for the first time before it's assumed its proper name. You can use -recheck-with-time-limit to enable this feature only for a specific duration after process starts.