These changes prevent segmentation faults when reading and writing multi-file datasets with recent netCDF4 versions (see https://github.com/contrailcirrus/pycontrails/pull/204) and allow us to remove upper limits on netCDF4 and numpy versions.
Remove lock=False as a default keyword argument to xr.open_mfdataset in the MetDataSource.open_dataset method. This reverts a change from v0.44.1 and prevents segmentation faults when using recent versions of netCDF4 (1.7.0 and above).
Internals
Remove upper limits on netCDF4 and numpy versions.
Changes
These changes prevent segmentation faults when reading and writing multi-file datasets with recent netCDF4 versions (see https://github.com/contrailcirrus/pycontrails/pull/204) and allow us to remove upper limits on netCDF4 and numpy versions.
These changes revert a change (https://github.com/contrailcirrus/pycontrails/pull/68) made to address the issue described in https://github.com/pydata/xarray/issues/4406. That issue remains open, so this change may resurface problems with dask threadlocks.
Breaking changes
lock=Falseas a default keyword argument toxr.open_mfdatasetin theMetDataSource.open_datasetmethod. This reverts a change from v0.44.1 and prevents segmentation faults when using recent versions of netCDF4 (1.7.0 and above).Internals
Tests
make test)Reviewer