Do chunk sizes have to be the same for all variables in a given dimension?

sgkit-dev / sgkit

Scalable genetics toolkit

https://sgkit-dev.github.io/sgkit

Apache License 2.0

231 stars 32 forks source link

Do chunk sizes have to be the same for all variables in a given dimension? #1186

Open jeromekelleher opened 8 months ago

jeromekelleher commented 8 months ago

Does xarray mandate that Zarr chunk sizes must be the same for all variables with a given dimension? This is quite a hard restriction if so, as we can have fields like PL that are many times larger than GTs, and good chunk size choices for the two would be quite different.

hammer commented 8 months ago

I recall some uniform chunk size discussion on https://github.com/pydata/xarray/issues/2225 a while back, digging through my notes for more...