search

unity-sds / unity-project-management

Container repo for project management (projects, epics, etc)
Apache License 2.0
0 stars 1 forks source link

As an operator, I want to submit a batch of jobs to the system #49

Open mike-gangl opened 1 year ago

mike-gangl commented 1 year ago

a single request begets many parallel jobs (e.g. CWL scatter)

rtapella commented 1 year ago

[submit individuals jobs GUI is #72 ]

mike-gangl commented 1 year ago

Not entirely, that issue linked is for getting the status of a set of jobs based on a label; So we can "view" a set of related jobs (a batch). But just because we can view a set of jobs as a grouping does not mean we have submitted the "batch". a batch could be:

  1. Iterate by a script over each 16 day period, submitting the jobs with the same label, or
  2. Write a new workflow that takes some date range and does that splitting on their behalf

This would depend on how a user wants to submit that batch. if this is the case, then we really need the workflow monitoring in place to show us the status of workflows that are "spawned" or "fanned out" by the ADES- which would be another feature for the ADES (or really, an EMS) to implement.

Either way, i don't think this is getting into 23.2

rtapella commented 1 year ago

submit UI: https://github.com/unity-sds/unity-project-management/issues/72

Will require some additional wiring as well (e.g. iterate over a list of inputs)