search

unity-sds / unity-project-management

Container repo for project management (projects, epics, etc)
Apache License 2.0
0 stars 1 forks source link

As an operator, I want to monitor Batch submissions through the unity Science Data System #50

Closed mike-gangl closed 5 months ago

mike-gangl commented 1 year ago

monitoring means the propagation of workflow labels and the ability to view batch processing as a whole, individual workflows within the batch, and individual tasks within the workflow (e.g. drill down from the parent component to the child component).

rtapella commented 1 year ago

SPS + UI teams

mike-gangl commented 1 year ago

Need to discern how this is different than "Workflow monitoring" feature- https://github.com/unity-sds/unity-project-management/issues/38

rtapella commented 1 year ago

This is distinct in that it implements the monitoring of batches, not just jobs. This suggests some sort of aggregation/summary to keep track of job status at the level of an entire batch.

e.g. phase 1 = monitor single job status = running (etc.)

phase 2 = monitor batch of jobs status = 3 queued, 4 running, 1 failed

rtapella commented 9 months ago

Moving to 23.4 Requires job database and potentially logic on the server-side to view everything with a particular label (batch ID).

rtapella commented 5 months ago