Closed tomwhite closed 2 years ago
Thanks for reporting Tom. This feels vaguely similar to https://github.com/pangeo-forge/pangeo-forge-recipes/issues/259, which we successfully fixed.
In pangeo-forge-recipes, we have copied (and improved upon) the executor framework we are using in rechunker. So fixing this will likely involve bringing rechunker up to speed with those changes.
Chiming in to say that I am getting this same AssertionError
using Dask 2022.2.1, but did not get the error using Dask 2022.1.1. I was running Rechunker
version 0.3.3 just fine on Pangeo Cloud before the recent docker image update switched from Dask 2022.1.1 to 2022.2.1.
Hopefully fixed by #112.
@tomwhite is going to track down some example code from @eric-czech to ensure this fix works for us.
PR #112 seems to have fixed my issues! Thanks a bunch @rabernat!
Thanks @hammer! I've heard from a few folks already, and I'm feeling pretty confident that this issue is fixed. But would love as much feedback as possible. I will probably make a release early next week.
0.5.0 has been released.
Running the rechunker 0.3.3 unit tests with Dask 2022.2.0 gives lots of failures like the following.
It seems to have been introduced with this HLG change in Dask, released in Dask 2022.01.1.
This is a problem since we are stuck on rechunker 0.3.3 due to #92 (see also https://github.com/pystatgen/sgkit/issues/820).