Move Away from Dask Delayed API to Submit/Gather API

Earth-Information-System / fireatlas

3 stars 1 forks source link

Move Away from Dask Delayed API to Submit/Gather API #37

Closed ranchodeluxe closed 1 month ago

ranchodeluxe commented 1 month ago

Goal

The DAGs that @delayed allow us to create are finicky and fail without tracebacks or errors even for simple DAGs. Rewrite everything using submit/gather API hooks