google-research / arco-era5

Recipes for reproducing Analysis-Ready & Cloud Optimized (ARCO) ERA5 datasets.
https://cloud.google.com/storage/docs/public-datasets/era5
Apache License 2.0
305 stars 23 forks source link

Ingest all variables for single-level reanalysis. #17

Open alxmrs opened 2 years ago

alxmrs commented 2 years ago

Add a new single-level reanalysis config to ingest the remaining variables from ECMWF within the same time range. We can then create a new XArray-Beam pipeline to append variables to the existing CO Zarr dataset.

Variables are listed here: https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysis-era5-single-levels?tab=overview

We can create more DL configs like this one: https://github.com/google-research/arco-era5/blob/main/raw/era5_sfc_rad.cfg

See https://weather-tools.readthedocs.io/ or https://github.com/google-research/arco-era5/tree/main/raw for instructions on how to use weather-dl.

oliverwm1 commented 8 months ago

This would be very helpful.

Some particular variables that are missing which our team could use and which are not currently available are the surface sensible and latent heat fluxes, as well as all the TOA and surface radiative fluxes.