arcalot / arcaflow-engine

Arcaflow is a highly-portable workflow engine enabling modular and validated pipelines through containerized plugins.
https://arcalot.io/arcaflow/
Apache License 2.0
6 stars 9 forks source link

Implement signaling proposal #44

Open janosdebugs opened 1 year ago

janosdebugs commented 1 year ago

Please describe what you would like to see in this project

Implement the Arcaflow signals proposal.

dustinblack commented 1 year ago

test comment for jira sync

dustinblack commented 1 year ago

Issues #52 and #63 address the critical feature needs for "explicit serialization" and "smart parallelization" respectively, which I believe can both be addressed through the implementation of the signaling features.

Additionally, the affinity feature for the kubernetes deployer is currently limited by scheduler race conditions, which I believe can also be resolved with the signaling features.