search

cms-PdmV / Stats2

Stats2 - a workflow cache and history keeper for PdmV services
https://cms-pdmv.cern.ch/stats/
MIT License
0 stars 1 forks source link

Include `TotalInputLumis` field from ReqMgr2 when performing updates #11

Closed ggonzr closed 6 months ago

ggonzr commented 1 year ago

Related to PDMVDEV-65, improve the Stats2 update process to include the attributes LumiList and TotalInputLumis available in ReqMgr2 workflow dictionary. To conclude, retrieve and display the number of lumisections for each produced dataset in case the requests is related to ReReco and it has been injected using LumiWhiteList.

Is your feature related to a problem?

The attribute TotalInputEvents has been incorrectly calculated for some ReReco workflows due to an error in the parent tool (ReqMgr2), this creates issues in PdmV monitoring tools like Stats2 and pMp (for more details, please see the JIRA issue). Among them, the progress percentage for some requests is more than 100%.

Describe the solution you'd like

The attribute TotalInputLumis is included in the data retrieved for Stats2 for each request and the completion percentage is computed based on the lumisections and not the total events.

Current behavior

Only the total number of events is used to compute the progress percentage and this value is miscalculated for some ReReco requests

Expected behavior

The progress percentage for ReReco requests injected with LumiWhiteList is computed based on lumisections. The progress bar is plotted based on the new percentage.