LSSTDESC / desc-wfmon

Workflow monitor for DESC image processing
BSD 3-Clause "New" or "Revised" License
0 stars 0 forks source link

Task running times are too long #7

Closed dladams closed 1 year ago

dladams commented 2 years ago

The task running times can sometimes appear much longer that I expect. See the attached plot. The run times are from the try table.

image

dladams commented 2 years ago

Ben points out that there is a status table with separate times for end of running and end of processing. I see these five states: [‘pending’ ‘launched’ ‘running’ ‘running_ended’ ‘exec_done’]. I will try adding these to the fixed try table.

dladams commented 2 years ago

I added fields with the five status timestamps to the fixed try table. Change is committed and tagged v0.25.0.

dladams commented 2 years ago

I have modified the monexp notebook to use running time based on the status vales and added post-processing time to the last latency (task processing period) plot. An example of the latter is included here.

This change is committed to version 0.25.2.

image