Open rabernat opened 3 years ago
Dask recently released some advanced graph manipulation tools, which includes a checkpoint function.
checkpoint
We could use this instead of our low-level hack to make a checkpoint here:
https://github.com/pangeo-data/rechunker/blob/6cc0f26720bfecb1eba00579a13d9b7c8004f652/rechunker/executors/dask.py#L51-L53
Dask recently released some advanced graph manipulation tools, which includes a
checkpoint
function.We could use this instead of our low-level hack to make a checkpoint here:
https://github.com/pangeo-data/rechunker/blob/6cc0f26720bfecb1eba00579a13d9b7c8004f652/rechunker/executors/dask.py#L51-L53