Many frameworks like dask, jobflow, snakemake and pyiron_workflow internally construct workflow graphs and have the feature to represent those as dictionaries. It would be great to develop an abstract standard which allows converting workflow graphs from the different frameworks to the more general standard. Especially this would allow pyiron_workflow to execute workflows defined for one of the existing frameworks.
Detailed Description
pyiron_workflow supports more complex workflow graphs than most existing solutions. The features include:
cyclic graphs
python functions
external executables
multiple outputs
...
As a consequence it should be possible to convert a workflow from dask, jobflow or snakemake to an pyiron_workflow. As all four frameworks already have a dictionary representation, it should be possible to define a generic workflow graph format and then convert existing workflows in this generic format.
Summary
Many frameworks like
dask,jobflow,snakemakeandpyiron_workflowinternally construct workflow graphs and have the feature to represent those as dictionaries. It would be great to develop an abstract standard which allows converting workflow graphs from the different frameworks to the more general standard. Especially this would allowpyiron_workflowto execute workflows defined for one of the existing frameworks.Detailed Description
pyiron_workflowsupports more complex workflow graphs than most existing solutions. The features include:As a consequence it should be possible to convert a workflow from
dask,jobfloworsnakemaketo anpyiron_workflow. As all four frameworks already have a dictionary representation, it should be possible to define a generic workflow graph format and then convert existing workflows in this generic format.Further Information, Files, and Links