load netcdf

[peterdudfield]

Still struggling to load netcdf file from s3, could we show an example on how to do this?

I tried

with fsspec.open("simplecache::s3://nowcasting-nwp-development/data/latest.netcdf", mode="rb") as f:
    nwp = xr.load_dataset(f, engine='h5netcdf')

ValueError: b'' is not the signature of a valid netCDF4 file

and

with fsspec.open("simplecache::s3://nowcasting-nwp-development/data/latest.netcdf", mode="r") as f:
    nwp = xr.load_dataset(f, engine='h5netcdf')

TypeError: startswith first arg must be str or a tuple of str, not bytes

[peterdudfield]

with fsspec.open("s3://nowcasting-nwp-development/data/latest.netcdf", mode="rb""") as f:
    nwp = xr.load_dataset(f, engine='h5netcdf')

is the same error

[peterdudfield]

The current save method is

The current save method is

with fsspec.open("simplecache::s3://nowcasting-nwp-development/data/test.netcdf", mode="wb") as f:
    dataset.to_netcdf(f,engine='h5netcdf')

[peterdudfield]

This might work - it did not

with fsspec.open("s3://nowcasting-nwp-development/data/test.netcdf", mode="rb") as f:
    file_bytes = f.read()
with io.BytesIO(file_bytes) as file:
    nwp = xr.load_dataset(file, engine='h5netcdf')