Open shoyer opened 2 months ago
Quick note to check my own understanding. Which specific files are updated monthly with that delay?
I think all of the Zarr files listed in the README should be updated with that cadence.
@shoyer @dgilford One small correction: All of the zarr file which mentioned into the readme.md except this 'gs://gcp-public-data-arco-era5/ar/model-level-1h-0p25deg.zarr-v1' are updated on monthly cadence.
Currently, ARCO-ERA5 is updated monthly with a 3 month delay. This matches when the "final" version of ERA5 is available, ~2 months delayed.
However, there is also a preliminary version of ERA5 called ERA5T, which is updated daily with a ~5 day delay. In theory, ERA5T could look different from the final version of ERA5, but according to ECMWF this has only happened once.
In practice, I think we could safely update ARCO-ERA5 to update much more frequently, which would be quite useful for downstream operations. Let's look into this after solving the current race condition involved with resizing datasets: https://github.com/google-research/arco-era5/issues/81