Swap to Hamilton DAG - Githubissues

FAST-HEP / fasthep-flow

Convert YAML into a workflow DAG

Apache License 2.0

1 stars 1 forks source link

Swap to Hamilton DAG #34

Closed kreczko closed 1 month ago

kreczko commented 1 month ago

After careful consideration, switching from prefect to Hamilton due to

simpler API for workflow conversion
easy caching and Dask configuration
better virtualisation and the ability to import flows

This PR:

removes prefect
renamed stages to tasks
adds Workflow disk persistence
switches to Python > 3.11 (hashlib constraint)

TODO: update docs for Hamilton usage