One of the benefits of our in-house multiprocessing scheduler is that it has no external library dependency.
However, we do currently make use of some utilities from dask which makes dask a non-optional dependency to dagrunner right now.
Ideally we would make dask, ray or any future library for additional scheduler capability optional.
One of the benefits of our in-house multiprocessing scheduler is that it has no external library dependency. However, we do currently make use of some utilities from dask which makes dask a non-optional dependency to dagrunner right now. Ideally we would make dask, ray or any future library for additional scheduler capability optional.