Fail during planning if map_blocks drop_axis is for a chunked dimension

cubed-dev / cubed

Bounded-memory serverless distributed N-dimensional array processing

https://cubed-dev.github.io/cubed/

Apache License 2.0

122 stars 14 forks source link

Fail during planning if map_blocks drop_axis is for a chunked dimension #569

Closed tomwhite closed 2 months ago

tomwhite commented 2 months ago

Cubed does not automatically concatenate chunks in blockwise operations (by design - since it can lead to large memory usage), and will fail in this situation. This PR makes the failure happen during planning rather than during computation, and improves the error message.