search

google / xarray-beam

Distributed Xarray with Apache Beam
https://xarray-beam.readthedocs.io
Apache License 2.0
134 stars 7 forks source link

Race condition in ChunksToZarr when template is not supplied explicitly as an xarray.Dataset #85

Open shoyer opened 1 year ago

shoyer commented 1 year ago

Due to https://github.com/zarr-developers/zarr-python/issues/1435, ChunkToZarr can result in invalid Zarr files if the template is written simultaneously from different workers.