Recipe testing and output comparison for release 2.10.0

[zklaus]

This issue documents recipe testing for the v2.10.0 release

Installation and environment

$ git clone https://github.com/ESMValGroup/ESMValTool.git
$ cd ESMValTool
$ git checkout v2.10.x
$ mamba env create -n esmvaltool-v2.10.x-2023-11-13 -f environment.yml
$ conda activate esmvaltool-v2.10.x-2023-11-13
$ pip install .

Environment file

environment.txt

Config user file

All options at the default for Levante except search_esgf: when_missing.

[zklaus]

Recipe running session 2023-11-14 13:51:43.524394

Successfully ran recipes

115 out of 155

Recipes that failed with DiagnosticError

15 out of 155

• recipe_anav13jclim.yml (#3420)
• recipe_collins13ipcc.yml (#3420)
• recipe_gier2020bg.yml (#3420)
• recipe_julia.yml
• recipe_landcover.yml
• recipe_perfmetrics_CMIP5.yml (#3420)
• recipe_perfmetrics_CMIP5_4cds.yml (#3420)
• recipe_perfmetrics_land_CMIP5.yml (#3420)
• recipe_psyplot.yml
• recipe_rainfarm.yml
• recipe_russell18jgr.yml (#3420)
• recipe_seaice_drift.yml
• recipe_tebaldi21esd.yml (#3420)
• recipe_wenzel14jgr.yml (#3420)
• recipe_wenzel16jclim.yml (#3420)

Recipes that failed of Missing Data

4 out of 155

• recipe_bock20jgr_fig_1-4.yml
• recipe_check_obs.yml
• recipe_clouds_bias.yml
• recipe_lauer13jclim.yml

Recipes that failed for other reasons

21 out of 155 so far

• recipe_bock20jgr_fig_6-7.yml
• recipe_climate_change_hotspot.yml
• recipe_daily_era5.yml
• recipe_easy_ipcc.yml
• recipe_eyring06jgr.yml
• recipe_eyring13jgr_12.yml
• recipe_ipccwg1ar6ch3_atmosphere.yml
• recipe_ipccwg1ar6ch3_fig_3_19.yml
• recipe_ipccwg1ar6ch3_fig_3_42_a.yml
• recipe_ipccwg1ar6ch3_fig_3_42_b.yml
• recipe_ipccwg1ar6ch3_fig_3_9.yml
• recipe_lauer22jclim_fig3-4_zonal.yml
• recipe_lauer22jclim_fig5_lifrac.yml
• recipe_marrmot.yml
• recipe_pcrglobwb.yml
• recipe_schlund20jgr_gpp_abs_rcp85.yml
• recipe_schlund20jgr_gpp_change_1pct.yml
• recipe_schlund20jgr_gpp_change_rcp85.yml
• recipe_smpi.yml
• recipe_smpi_4cds.yml
• recipe_wflow.yml

[bouweandela]

Continued in #3463