search

LSSTDESC / desc-wfmon

Workflow monitor for DESC image processing
BSD 3-Clause "New" or "Revised" License
0 stars 0 forks source link

perfstat parse failing #12

Open dladams opened 12 months ago

dladams commented 12 months ago

The parse of the perfstat info in the g3wfpipe logs fails intermittently and those runs are excluded from the stats and the perfstat nb fails.

It appears the parser (in wfmon/perfstat.py) is parsing the log starting at the second line and continuing until a line starting with any of ['real', 'user', 'sys'] are found. This was triggered by the output or the time command but that is not being run since g3wfpipe switched to using the task wrapper.

I modified the code so a line startiong with 'Performance counter stats for' begins the parsing and the perfstat field 'sys' stops the parsing.

dladams commented 11 months ago

Oops, last mod introduced a bug. Fixed in 0.26.22.