search

EC-Earth / ece2cmor3

Post-processing and cmorization of ec-earth output
Apache License 2.0
13 stars 6 forks source link

problem with variable mrsow in LS3MIP experiments #594

Closed francocatalano closed 4 years ago

francocatalano commented 4 years ago

The ece2cmor computation of LS3MIP variable mrsow requires constant field soil type (43.128). The LS3MIP experiments have been run saving this variable only in the in the +000000 ICMGG output file. For some reason, it looks like ece2cmor3 expects to find field 43.128 in all the output ICMGG files. This gives the following error when runing ece2cmor3: 2020-02-13 11:21:18 ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 43.128, level type 1, level 0. Dismissing task mrsow in table Eday In order to solve this problem ece2cmor3 has to be modified to read constant field 43.128 only once from ICMGG+000000 file. @treerink @goord

francocatalano commented 4 years ago

Ops...I forgot pull. Thanks @treerink Running the test now. Then, I will also check results with nctime. I'll let you know as soon as the test and the checks are done.

francocatalano commented 4 years ago

@goord With the flux-inst-bugfix I now get a lot of these new errors: 2020-04-16 15:35:14 ERROR:ece2cmor3.cdoapi: (returncode:1) cdo(2) selcode: Process started cdo(2) selcode: Open failed on >/< Is a directory

2020-04-16 15:35:14 ERROR:ece2cmor3.postproc: Could not retrieve pressure levels for wap with axes []

I am running ece2cmor3 in a directory with concatenated december files: /scratch/ms/it/ccfc/cmorisation/temp_work/ifs the same directory I have been using with master branch. Is there anything incompatible with the flux-inst-bugfix branch?

goord commented 4 years ago

Hi Franco, sorry about that, I was a bit enthousiastic in refactoring some code in that branch, could you update (pull) and try once more?

francocatalano commented 4 years ago

Hi @goord @treerink The cmorization with the new flux-inst-bugfix branch completed without any error in the logfiles. The timeseries of hfdsl and hfdsn look complete (both dimension and time stamp of the files are reasonable). I have run nctime and it completed without any error as well:

:: COMMAND :: /home/ms/it/ccfc/.local/bin/nctcck -i esgini-dir -l log-nctcck CMIP6 Number of node(s): 11858 Number of dataset(s): 98 Number of dataset(s) with overlap(s): 0 Number of dataset(s) with broken time series: 0 Number of file(s) scanned: 11858 Number of file(s) skipped: 0

@treerink you can proceed with test-all. After that, if your tests are ok, I'll close the issue. Thank you guys for the very good job!

treerink commented 4 years ago

The #624 is merged into the master, fixing the remaining hfdsl issue in this issue.