google / xarray-beam

Distributed Xarray with Apache Beam
https://xarray-beam.readthedocs.io
Apache License 2.0
126 stars 7 forks source link

Multi-stage rechunking #10

Closed shoyer closed 1 year ago

shoyer commented 3 years ago

xref https://github.com/pangeo-data/rechunker/pull/89

This seems like a good idea for efficiently processing large datasets.

shoyer commented 1 year ago

This was implemented in https://github.com/google/xarray-beam/pull/14