Some tasks may be parallelizable (in the sense that they are "safe" (e.g., not performance sensitive) to run concurrently with other tasks). It would be useful if the user could specify this when defining their tasks. Then Conductor should launch parallelizable tasks concurrently on behalf of the user.
[x] Refactor task execution to enable parallel execution (#47)
geoffxy
commented
2 years ago
Some tasks may be parallelizable (in the sense that they are "safe" (e.g., not performance sensitive) to run concurrently with other tasks). It would be useful if the user could specify this when defining their tasks. Then Conductor should launch parallelizable tasks concurrently on behalf of the user.