search

ESMValGroup / ESMValTool

ESMValTool: A community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP
https://www.esmvaltool.org
Apache License 2.0
211 stars 124 forks source link

New release candidate for ESMValCore `esmvalcore=2.7.0rc2` is out in the wild; test ESMValTool with it #2833

Closed valeriupredoi closed 1 year ago

valeriupredoi commented 1 year ago

@ESMValGroup/esmvaltool-developmentteam we now have a pre-release candidate for ESMValCore, namely RC2, which sits nicely on conda-forge and PyPi. For that purpose I have now created a special branch for testing ESMValTool with this pre-release candidate, namely https://github.com/ESMValGroup/ESMValTool/tree/core_v270rc2 which I am encouraging you to use to test your favourite recipe(s). As soon as the Github Actions finish (they are currently degraged yet again within 24h - GitHub's fault not ours) I will post the complete list of recipes that we will use to check boxes for recipes that run fine, or get to the bottom of any fail via GH issues. Stay tuned for the heads up soon! :beer:

Pro tip: make sure your intermediary cubes are not saved (check config) otherwise you will end up like me swearing at JASMIN's meager disk quota (which is OK, but not OK enough to save a bazillion intermediary cubes :laughing: )

valeriupredoi commented 1 year ago

OK folks CI tests passing GA: noice and Circle: smoothly with the new Core RC2 :parasol_on_ground:

Here is the list of recipes we must run with this guy, I will fire up the auto testing on DKRZ/Levante (as soon as I am allowed to get on to that HPC and run shtuffs), so you shouldn't be asked to run your favourite recipe just - unless you want to help out (which would be nice, but not required) and unless I specifically ask you (nicely) to :beer:

valeriupredoi commented 1 year ago

@ESMValGroup/esmvaltool-developmentteam I would be etrnally grateful if you could test 1-2 or more recipes of your choice and faith from the list above, please - I will be running the ones that don't get much attention from you myself, but it'd be very cool if I didn't have to run the whole list, you know :grin: For testing, please use the ESMValCore rc2 branch https://github.com/ESMValGroup/ESMValTool/tree/core_v270rc2 like this:

cd ~/ESMValTool  # or alternatively if you don't have it, clone it first with git clone https://github.com/ESMValGroup/ESMValTool.git
git fetch -v
git checkout core_v270rc2
# activate your conda (base) environment then install mamba if you don't have it with conda install -c conda-forge mamba
mamba env create -n coreRC2 -f environment.yml
conda activate core RC2
pip install -e .[develop]

you now should have a working esmvaltool with the Core pre-release candidate for testing; once your recipe has run, please tick the box in the comment above, if it failed, then please post a comment here with the full Traceback (either from on-screen or from the log) or attach the log. Very many thanks in advance :beer:

valeriupredoi commented 1 year ago

@ESMValGroup/esmvaltool-developmentteam this is me right now, after running more recipes than in my entire 5+ years of ESMValX development history put together :grin: VRM

valeriupredoi commented 1 year ago

@remi-kazeroni @sloosvel running recipe recipe_climate_change_hotspot.yml on Levante am getting this

2022-10-11 11:00:19,448 UTC [4189991] ERROR   Missing data for preprocessor tas_cmip6_85/tas:
- Missing data for INM-CM4-8: tas
- Missing data for INM-CM5-0: tas
2022-10-11 11:00:19,448 UTC [4189991] ERROR   Missing data for preprocessor pr_cmip6_85/pr:
- Missing data for INM-CM4-8: pr
- Missing data for INM-CM5-0: pr
- No input data available for years 2015-2100 in files:
/work/bd0854/DATA/ESMValTool2/CMIP6_DKRZ/CMIP/NCAR/CESM2/historical/r2i1p1f1/Amon/pr/gn/v20190401/pr_Amon_CESM2_historical_r2i1p1f1_gn_185001-201412.nc

am using Saskia's config user file - you guys know where the missing CMIP6 data may be by any chance? No way I can run it on JASMIN since it's missing OBS's - I have now turned on auto dll's let's see what's the hap with it, but do we tell DKRZ they're missing CMIP6 data or we just let it pass?

EDIT OK - it seems ESGF doesn't have them either:

2022-10-11 11:06:52,351 UTC [48716] ERROR   No input files found for variable {'mip': 'Amon', 'short_name': 'pr', 'preprocessor': 'ensemble_members', 'variable_group': 'pr', 'diagnostic': 'pr_cmip6_85', 'project': 'CMIP6', 'exp': ['historical', 'ssp585'], 'dataset': 'INM-CM4-8', 'ensemble': 'r1i1p1f1', 'grid': 'gr', 'recipe_dataset_index': 25, 'timerange': '1980/2100', 'institute': ['INM'], 'activity': ['CMIP', 'ScenarioMIP'], 'alias': 'INM-CM4-8', 'original_short_name': 'pr', 'standard_name': 'precipitation_flux', 'long_name': 'Precipitation', 'units': 'kg m-2 s-1', 'modeling_realm': ['atmos'], 'frequency': 'mon', 'start_year': 1980, 'end_year': 2100}
2022-10-11 11:06:52,352 UTC [48716] ERROR   Looked for files matching
ESGF:/pr_Amon_INM-CM4-8_historical_r1i1p1f1_gr*.nc
ESGF:/pr_Amon_INM-CM4-8_ssp585_r1i1p1f1_gr*.nc
2022-10-11 11:06:52,352 UTC [48716] ERROR   Set 'log_level' to 'debug' to get more information
2022-10-11 11:06:52,490 UTC [48716] ERROR   No input files found for variable {'mip': 'Amon', 'short_name': 'pr', 'preprocessor': 'ensemble_members', 'variable_group': 'pr', 'diagnostic': 'pr_cmip6_85', 'project': 'CMIP6', 'exp': ['historical', 'ssp585'], 'dataset': 'INM-CM5-0', 'ensemble': 'r1i1p1f1', 'grid': 'gr', 'recipe_dataset_index': 26, 'timerange': '1980/2100', 'institute': ['INM'], 'activity': ['CMIP', 'ScenarioMIP'], 'alias': 'INM-CM5-0', 'original_short_name': 'pr', 'standard_name': 'precipitation_flux', 'long_name': 'Precipitation', 'units': 'kg m-2 s-1', 'modeling_realm': ['atmos'], 'frequency': 'mon', 'start_year': 1980, 'end_year': 2100}
2022-10-11 11:06:52,490 UTC [48716] ERROR   Looked for files matching
ESGF:/pr_Amon_INM-CM5-0_ssp585_r1i1p1f1_gr*.nc
ESGF:/pr_Amon_INM-CM5-0_historical_r1i1p1f1_gr*.nc

-> are we aware of this from the previous releases or this is something new?

sloosvel commented 1 year ago

@remi-kazeroni @sloosvel running recipe recipe_climate_change_hotspot.yml on Levante am getting this

2022-10-11 11:00:19,448 UTC [4189991] ERROR   Missing data for preprocessor tas_cmip6_85/tas:
- Missing data for INM-CM4-8: tas
- Missing data for INM-CM5-0: tas
2022-10-11 11:00:19,448 UTC [4189991] ERROR   Missing data for preprocessor pr_cmip6_85/pr:
- Missing data for INM-CM4-8: pr
- Missing data for INM-CM5-0: pr
- No input data available for years 2015-2100 in files:
/work/bd0854/DATA/ESMValTool2/CMIP6_DKRZ/CMIP/NCAR/CESM2/historical/r2i1p1f1/Amon/pr/gn/v20190401/pr_Amon_CESM2_historical_r2i1p1f1_gn_185001-201412.nc

am using Saskia's config user file - you guys know where the missing CMIP6 data may be by any chance? No way I can run it on JASMIN since it's missing OBS's - I have now turned on auto dll's let's see what's the hap with it, but do we tell DKRZ they're missing CMIP6 data or we just let it pass?

EDIT OK - it seems ESGF doesn't have them either:

2022-10-11 11:06:52,351 UTC [48716] ERROR   No input files found for variable {'mip': 'Amon', 'short_name': 'pr', 'preprocessor': 'ensemble_members', 'variable_group': 'pr', 'diagnostic': 'pr_cmip6_85', 'project': 'CMIP6', 'exp': ['historical', 'ssp585'], 'dataset': 'INM-CM4-8', 'ensemble': 'r1i1p1f1', 'grid': 'gr', 'recipe_dataset_index': 25, 'timerange': '1980/2100', 'institute': ['INM'], 'activity': ['CMIP', 'ScenarioMIP'], 'alias': 'INM-CM4-8', 'original_short_name': 'pr', 'standard_name': 'precipitation_flux', 'long_name': 'Precipitation', 'units': 'kg m-2 s-1', 'modeling_realm': ['atmos'], 'frequency': 'mon', 'start_year': 1980, 'end_year': 2100}
2022-10-11 11:06:52,352 UTC [48716] ERROR   Looked for files matching
ESGF:/pr_Amon_INM-CM4-8_historical_r1i1p1f1_gr*.nc
ESGF:/pr_Amon_INM-CM4-8_ssp585_r1i1p1f1_gr*.nc
2022-10-11 11:06:52,352 UTC [48716] ERROR   Set 'log_level' to 'debug' to get more information
2022-10-11 11:06:52,490 UTC [48716] ERROR   No input files found for variable {'mip': 'Amon', 'short_name': 'pr', 'preprocessor': 'ensemble_members', 'variable_group': 'pr', 'diagnostic': 'pr_cmip6_85', 'project': 'CMIP6', 'exp': ['historical', 'ssp585'], 'dataset': 'INM-CM5-0', 'ensemble': 'r1i1p1f1', 'grid': 'gr', 'recipe_dataset_index': 26, 'timerange': '1980/2100', 'institute': ['INM'], 'activity': ['CMIP', 'ScenarioMIP'], 'alias': 'INM-CM5-0', 'original_short_name': 'pr', 'standard_name': 'precipitation_flux', 'long_name': 'Precipitation', 'units': 'kg m-2 s-1', 'modeling_realm': ['atmos'], 'frequency': 'mon', 'start_year': 1980, 'end_year': 2100}
2022-10-11 11:06:52,490 UTC [48716] ERROR   Looked for files matching
ESGF:/pr_Amon_INM-CM5-0_ssp585_r1i1p1f1_gr*.nc
ESGF:/pr_Amon_INM-CM5-0_historical_r1i1p1f1_gr*.nc

-> are we aware of this from the previous releases or this is something new?

You can run it with --skip-nonexistent, no problem. Also I don't think this is using any OBS, so you can run it on jasmin.

valeriupredoi commented 1 year ago

great, will do's, cheers @sloosvel :beer:

bouweandela commented 1 year ago

If the data is not on ESGF either, it may have been retracted?

In that case it should be removed from the recipe, as decided at the previous workshop and on it's way to the documentation but not quite merged yet in #2720.

valeriupredoi commented 1 year ago

@sloosvel you were right - that wretched recipe runs fine with --skip-nonexistent, hefty bugger too

valeriupredoi commented 1 year ago

OK I am fairly happy with how our Core RC has been performing, if there are no major objections from the @ESMValGroup/technical-lead-development-team I shall release us a Core 2.7.0 stable tomorrow - lucky 13th :grin:

valeriupredoi commented 1 year ago

@ESMValGroup/esmvaltool-developmentteam Core's stable 2.7.0 has been released to PyPi earlier today, with the PR to conda-forge having just been merged now (the regro bot was ill all day until now) https://github.com/conda-forge/esmvalcore-feedstock/pull/50 - am closing this with many thanks to those who tested Core 2.7.0, and welcoming ESMValCore v2.7.0 to the world, a plucky little chap :grin: