ESMValGroup / ESMValTool

ESMValTool: A community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP
https://www.esmvaltool.org
Apache License 2.0
218 stars 127 forks source link

recipe_checks_obs.yml cannot find required input data on Levante #3472

Closed bouweandela closed 10 months ago

bouweandela commented 10 months ago

The run ends with the following messages:

2023-12-12 21:10:37,928 UTC [384101] ERROR   Missing data for preprocessor JRA-25/clt:
- Missing data for Dataset: clt, Amon, OBS6, JRA-25, 1
2023-12-12 21:10:37,928 UTC [384101] ERROR   Missing data for preprocessor JRA-25/hus:
- Missing data for Dataset: hus, Amon, OBS6, JRA-25, 1
2023-12-12 21:10:37,928 UTC [384101] ERROR   Missing data for preprocessor JRA-25/prw:
- Missing data for Dataset: prw, Amon, OBS6, JRA-25, 1
2023-12-12 21:10:37,928 UTC [384101] ERROR   Missing data for preprocessor JRA-25/rlut:
- Missing data for Dataset: rlut, Amon, OBS6, JRA-25, 1
2023-12-12 21:10:37,928 UTC [384101] ERROR   Missing data for preprocessor JRA-25/rlutcs:
- Missing data for Dataset: rlutcs, Amon, OBS6, JRA-25, 1
2023-12-12 21:10:37,928 UTC [384101] ERROR   Missing data for preprocessor JRA-25/rsut:
- Missing data for Dataset: rsut, Amon, OBS6, JRA-25, 1
2023-12-12 21:10:37,928 UTC [384101] ERROR   Missing data for preprocessor JRA-25/rsutcs:
- Missing data for Dataset: rsutcs, Amon, OBS6, JRA-25, 1
2023-12-12 21:10:37,929 UTC [384101] ERROR   Missing data for preprocessor NOAA-MBL-CH4/ch4s:
- Missing data for Dataset: ch4s, Amon, OBS6, NOAA-MBL-CH4, 1.0
2023-12-12 21:10:37,929 UTC [384101] ERROR   Missing data for preprocessor ERA5_native6/rlus_E1hr:
- Missing data for Dataset: rlus, E1hr, native6, ERA5, v1
2023-12-12 21:10:37,929 UTC [384101] ERROR   Missing data for preprocessor ERA5_native6/rsus_E1hr:
- Missing data for Dataset: rsus, E1hr, native6, ERA5, v1
2023-12-12 21:10:37,929 UTC [384101] ERROR   Missing data for preprocessor ERA5_native6/rlus_Amon:
- Missing data for Dataset: rlus, Amon, native6, ERA5, v1
2023-12-12 21:10:37,929 UTC [384101] ERROR   Missing data for preprocessor ERA5_native6/rsus_Amon:
- Missing data for Dataset: rsus, Amon, native6, ERA5, v1

It looks like JRA-25 has been moved (changed?) to the directory /work/bd0854/DATA/ESMValTool2/OBS/Tier2/JRA-25.ESGF/, which does exist, but /work/bd0854/DATA/ESMValTool2/OBS/Tier2/JRA-25/ does not exist.

/work/bd0854/DATA/ESMValTool2/OBS/Tier2/NOAA-MBL-CH4 does not exist either.

@ESMValGroup/obs-maintainers Could you have a look please?

axel-lauer commented 10 months ago

JRA-25 data were in the process of being moved (https://github.com/ESMValGroup/ESMValTool/pull/3470) a bit too early by mistake. I just corrected this.

bouweandela commented 10 months ago

The missing data for ERA5 is probably caused by https://github.com/ESMValGroup/ESMValCore/issues/1388, so that only leaves the NOAA-MBL-CH4 dataset. It looks it was not CMORized and put in the correct place by the @ESMValGroup/obs-maintainers in https://github.com/ESMValGroup/ESMValTool/pull/3301. @ESMValGroup/obs-maintainers Would anyone have time to do that?

hb326 commented 10 months ago

@bouweandela: I added the NOAA-MBL-CH4 data to the Levante data pool. The recipe should now work fine. The data got not transfered since the CMORizer was reviewed by @remi-kazeroni before he left, but could not get merged before an addition to the ESMValCore was available in the main branch.

bouweandela commented 10 months ago

Thanks! :partying_face:

bouweandela commented 10 months ago

Closing this as all input data is now in place.