Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.
Is your feature request related to a problem? Please describe.
We updated the RayGraphAdapter to work with the HamiltonTracker. We should do the same for the DaskGraphAdapter.
Describe the solution you'd like
For people using tasks, have it mirror the RayGraphAdapter.
For those using dask datatypes -- I don't believe there needs to be any change.
For those using both -- we'd need to think through.
Is your feature request related to a problem? Please describe. We updated the RayGraphAdapter to work with the HamiltonTracker. We should do the same for the DaskGraphAdapter.
Describe the solution you'd like For people using tasks, have it mirror the RayGraphAdapter. For those using dask datatypes -- I don't believe there needs to be any change. For those using both -- we'd need to think through.
Describe alternatives you've considered N/A
Additional context https://github.com/DAGWorks-Inc/hamilton/pull/1103