search

google / xarray-beam

Distributed Xarray with Apache Beam
https://xarray-beam.readthedocs.io
Apache License 2.0
125 stars 7 forks source link

Register Beam coder(s) to avoid "Using fallback deterministic coder" warnings #77

Open shoyer opened 1 year ago

shoyer commented 1 year ago

Currently, running an Xarray-Beam pipeline generates (irrelevant) warnings about using fallback deterministic coders: WARNING:apache_beam.coders.coder_impl:Using fallback deterministic coder for type '<class 'xarray_beam._src.core.Key'>' in '[6]: Mean/PerKey/CombinePerKey(MeanCombineFn)/GroupByKey'.

Theoretically, we should be able to explicitly register coders for xarray_beam.Key and tuple[xarray_beam.Key, xarray.Dataset] to turn these off.