cylc / cylc-uiserver

A Jupyter Server extension that serves the cylc-ui web application for monitoring and controlling Cylc workflows.
https://cylc.org
GNU General Public License v3.0
15 stars 18 forks source link

job metrics: exclude skip / dummy mode tasks #626

Open oliver-sanders opened 2 months ago

oliver-sanders commented 2 months ago

Cylc can run tasks in a few different modes:

The job metrics used by the analysis views are only interested in "Live" tasks, all of the other modes are various forms of simulation.

A common use case for "skip" mode might be to skip a cycle of tasks that are no longer needed in order to allow the workflow to catch up. These skipped tasks will cause a blip in the analysis view as they succeed instantly.

Ideally we would omit these tasks from the analysis statistics to avoid them messing up the averages.

You should be able to tell which mode a task was run in by looking at the "platform" field in the DB. For more details ask @wxtim.

Note, make sure any solution is back-compatible to Cylc 8.3.0 databases.

wxtim commented 2 months ago

Dummy and simulation modes are back to being set for the whole workflow. You can't change mode of a running task to dummy or sim in an otherwise live workflow. This means that we only need to weed out skip mode tasks. If a user runs the workflow in sim or dummy mode then all the data in the job metrics view is meaningless. It might be worth popping up some sort of warning if the workflow is being run in dummy or sim mode.