ESMValGroup / ESMValTool

ESMValTool: A community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP
https://www.esmvaltool.org
Apache License 2.0
222 stars 128 forks source link

Add support for the ERA5 ensemble #2467

Open babdollahi opened 2 years ago

babdollahi commented 2 years ago

Hi, I want to run the GlobWat recipe with the ERA5 ensemble. However, I could not find it in the supported datasets list. I was wondering if you could guide me in using this dataset or adding support for this dataset. Thanks

zklaus commented 2 years ago

It is a bit hidden, but if you read the section cmorization as a fix in the documentation, you will find some information about ERA5 and a few more pointers.

babdollahi commented 2 years ago

Hi @zklaus, Thank you for the explanation. I was hoping you could help me understand how to utilize ERA5-ensemble as additional datasets in the recipe. I went to the website and only found information about ERA5 and ERA5-Land. So, shall I refer to the ERA5 ensemble as the ERA5-ensemble in the dataset entry? How should the data be stored in subdirectories? Similar to ERA5, in Tier 3? "era5-total-precipitation-2003-monthly-ensemble.nc" is the name of the data that I obtained using era5cli.

zklaus commented 2 years ago

Ah, now I understand better that you are specifically interested in the ensemble version of the data, i.e. the one where there is an additional dimension ensemble_number or similar.

Since this is about ERA5 and I think the support is based on era5cli, I would like to ask some colleagues for input.

@bvreede, @JaroCamphuijsen, do you have experience with the ensemble versions? Is this already supported in era5cli?

babdollahi commented 2 years ago

Yes exactly. I am interested in the ensemble version of the data. I can download it by adding --ensemble to the era5cli command. My main concern is with its CMORization and uses in the ESMValtool recipes. Is there any support for ERA5-ensemble's CMORization? Where should I store it in subdirectories so that I can utilize it as a new dataset in the ESMValtool recipes? Any assistance would be greatly appreciated. @zklaus

zklaus commented 2 years ago

It's good to know that it is already supported in era5cli. I am afraid I don't know enough to help with the support in ESMValTool. @SarahAlidoost, @Peter9192, @bouweandela, can you step in?

Peter9192 commented 2 years ago

I don't think this is currently possible. There are CMOR fixes for the 'default' era5 data and for era5-land (see https://github.com/ESMValGroup/ESMValCore/tree/main/esmvalcore/cmor/_fixes/native6). I guess for era5-ensemble data you'd need a separate fix file.

I've never worked with that dataset though. Not sure what would be needed to make that work.

zklaus commented 2 years ago

Having had a quick look at this, it seems the only difference is that it adds another axis to the cube with a dimensional coordinate that is the number of the ensemble member starting from 0 or 1.