helmholtz-analytics / heat

Distributed tensors and Machine Learning framework with GPU and MPI acceleration in Python
https://heat.readthedocs.io/
MIT License
209 stars 53 forks source link

[Bug]: `test_io` failure with netCDF4==1.7.1 #1536

Closed ClaudiaComito closed 3 months ago

ClaudiaComito commented 3 months ago

What happened?

CI has been failing since netcdf4 release 1.7.1 with [Errno - 101] (see below).

In an old netCDF4 issue I found the suggestion to import netCDF4 before h5py. This does seem to solve the problem (fixed in #1535 )

Code snippet triggering the error

No response

Error message or erroneous outcome

FAILED heat/core/tests/test_io.py::TestIO::test_load - OSError: [Errno -101] NetCDF: HDF error: '/builds/helmholtz-analytics/ci/heat/heat/datasets/iris.nc'
FAILED heat/core/tests/test_io.py::TestIO::test_load_netcdf - OSError: [Errno -101] NetCDF: HDF error: '/builds/helmholtz-analytics/ci/heat/heat/datasets/iris.nc'
FAILED heat/core/tests/test_io.py::TestIO::test_save - RuntimeError: NetCDF: Problem with HDF5 dimscales.
FAILED heat/core/tests/test_io.py::TestIO::test_save_exception - RuntimeError: NetCDF: Problem with HDF5 dimscales.
FAILED heat/core/tests/test_io.py::TestIO::test_save_netcdf - RuntimeError: NetCDF: Problem with HDF5 dimscales.

Version

main (development branch)

Python version

None

PyTorch version

None

MPI version

No response