ERA5 zarr file on Google Cloud

google-research / arco-era5

Recipes for reproducing Analysis-Ready & Cloud Optimized (ARCO) ERA5 datasets.

https://cloud.google.com/storage/docs/public-datasets/era5

Apache License 2.0

287 stars 22 forks source link

ERA5 zarr file on Google Cloud #71

Closed yuliang954 closed 4 months ago

yuliang954 commented 4 months ago

In the neuralgcm_inference demo, era5 data provided through Goggle cloud is inverted along the latitude axis on some days, for example, on 1981-03-16.

shoyer commented 4 months ago

Thanks for the report! I can confirm that this seems to be an issue in the ARCO-ERA5 dataset. I will transfer this issue over to the appropriate repository.

shoyer commented 4 months ago

To reproduce:

import gcsfs
import xarray

gcs = gcsfs.GCSFileSystem(token='anon')
path = 'gs://gcp-public-data-arco-era5/ar/full_37-1h-0p25deg-chunk-1.zarr-v3'
full_era5 = xarray.open_zarr(gcs.get_mapper(path), chunks=None)

# correct data
full_era5.sea_surface_temperature.sel(time='2020-01-01T00').plot.imshow(
    x='longitude', y='latitude', size=3, aspect=2)

# flipped data
full_era5.sea_surface_temperature.sel(time='1981-03-16T00').plot.imshow(
    x='longitude', y='latitude', size=3, aspect=2)

shoyer commented 4 months ago

This is a duplicate issue, so closing this in favor of #70