arcalot / arcaflow-engine

Arcaflow is a highly-portable workflow engine enabling modular and validated pipelines through containerized plugins.
https://arcalot.io/arcaflow/
Apache License 2.0
6 stars 9 forks source link

Reduce Duplicate Schema Retrievals #108

Open jaredoconnell opened 1 year ago

jaredoconnell commented 1 year ago

Please describe what you would like to see in this project

I would like to see the engine recognizing which steps have identical images, and only retrieve the schema once, instead of once for each step. This will speed up the workflow initialization noticeably in workflows with a lot of different steps using the same images.