Workflow Engine

[AndrewBabbitt97]

Is there an existing issue for this?

• [X] I have searched the existing issues

Is your feature request related to a problem? Please describe the problem.

We need a solution to building complex style workflows in Medulla. This is to orchestrate longer business oriented tasks and procedures.

In the past we have looked at Argo Workflows, and is still on the table but I want to open the discussion to additional options.

Describe the solution you'd like

This is an investigation oriented task with the goal of finding a proper solution to handle workflows for Medulla. Overall for this to be considered complete we must come to a consensus on what workflow engine to use. Even if one is not listed yet in this ticket, we are open to ideas so long as they meet the following requirements:

• Runs on k8s
• Can be deployed as a part of a helm chart
• Open source

Additional context

General Workflow Engine List:

• Awesome Workflow Engines

Some initial options:

• Argo Workflows
• Brigade
• Workflow Core
• WorkflowEngine.NET

[Slygecko]

Can we look into terraform as an option for a workflow engine?

[Slygecko]

we can also utilize terragrunt as a wrapper that provides additional tools.

[Slygecko]

Code-Red looks interesting. I think it would be worth exploring.