search

arcalot / arcaflow-engine

Arcaflow is a highly-portable workflow engine enabling modular and validated pipelines through containerized plugins.
https://arcalot.io/arcaflow/
Apache License 2.0
6 stars 9 forks source link

Add wait_for functionality for serial and parallel execution #97

Closed Harshith-umesh closed 11 months ago

Harshith-umesh commented 11 months ago

Changes introduced with this PR

This PR adds the wait_for condition, which enables a workflow step to wait for another step without having a direct dependency between the two.

Use the latest release of the python deployer

Adds test cases for serial and parallel execution in a workflow.

Moves the printversion logic to the top of the main.go file immediately after parsing all the flags. closes #52

Note: This is only one of the parts required to enable parallel execution #63 , the ability to terminate parallel steps is still being developed.

By contributing to this repository, I agree to the contribution guidelines.

dustinblack commented 11 months ago

I was successful in functionally testing this with a workflow. Great work!

Harshith-umesh commented 11 months ago

Race condition issue: https://github.com/arcalot/arcaflow-engine/issues/101