search

EC-Earth / ece2cmor3

Post-processing and cmorization of ec-earth output
Apache License 2.0
13 stars 6 forks source link

Remaining list of skipping/skipped variables #490

Closed treerink closed 5 years ago

treerink commented 5 years ago

The test-all-nemo-mip-variables which runs the piControl data request for IFS has the following remaining skipping messages (strongly reduced compared to the earlier reported lists: https://github.com/EC-Earth/ece2cmor3/issues/435#issuecomment-483650979 though based on a cmorisation of a historical run):

IFS variables with unsupported combination of dimensions:

2019-06-12 21:28:04 ERROR:ece2cmor3.ifs2cmor: Variable zg has unsupported combination of dimensions [u'latitude', u'plev19', u'time'] and will be skipped.
2019-06-12 21:28:04 ERROR:ece2cmor3.ifs2cmor: Variable ua has unsupported combination of dimensions [u'latitude', u'plev39', u'time'] and will be skipped.
2019-06-12 21:28:04 ERROR:ece2cmor3.ifs2cmor: Variable ta has unsupported combination of dimensions [u'latitude', u'plev39', u'time'] and will be skipped.

NEMO climatological variables:

2019-06-12 21:28:22 ERROR:ece2cmor3.nemo2cmor: Variable zhalfo needed for zhalfo in table Oclim was not found in NEMO output files... skipping task
oloapinivad commented 5 years ago

Hi @treerink,

also siddivvel is still missing, am I right? Or this have been solved?


2019-04-15 07:45:57 ERROR:ece2cmor3.nemo2cmor: Variable sidivvel needed for sidivvel in table SImon was not found in NEMO output files... skipping task````
treerink commented 5 years ago

I have to correct the NEMO list for the test-all-nemo-mip-variables test, it looks currently like:

ERROR:ece2cmor3.nemo2cmor: Variable siareaacrossline needed for siareaacrossline in table SImon was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable sidivvel needed for sidivvel in table SImon was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable sishevel needed for sishevel in table SImon was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable sistremax needed for sistremax in table SImon was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable sistresave needed for sistresave in table SImon was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable snmassacrossline needed for snmassacrossline in table SImon was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable cfc11 needed for cfc11 in table Oyr was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable difvho needed for difvho in table Oyr was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable difvso needed for difvso in table Oyr was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable ocontempdiff needed for ocontempdiff in table Oyr was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable ocontemppadvect needed for ocontemppadvect in table Oyr was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable ocontemppmdiff needed for ocontemppmdiff in table Oyr was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable ocontemprmadvect needed for ocontemprmadvect in table Oyr was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable ocontemptend needed for ocontemptend in table Oyr was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable osaltdiff needed for osaltdiff in table Oyr was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable osaltpadvect needed for osaltpadvect in table Oyr was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable osaltpmdiff needed for osaltpmdiff in table Oyr was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable osaltrmadvect needed for osaltrmadvect in table Oyr was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable osalttend needed for osalttend in table Oyr was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable somint needed for somint in table Oyr was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable tnpeo needed for tnpeo in table Oyr was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable diftrblo2d needed for diftrblo2d in table Oclim was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable diftrelo2d needed for diftrelo2d in table Oclim was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable diftrxylo2d needed for diftrxylo2d in table Oclim was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable difvho needed for difvho in table Oclim was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable difvmo needed for difvmo in table Oclim was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable difvmto needed for difvmto in table Oclim was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable difvso needed for difvso in table Oclim was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable difvtrto needed for difvtrto in table Oclim was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable dispkevfo needed for dispkevfo in table Oclim was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable dispkexyfo2d needed for dispkexyfo2d in table Oclim was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable tnkebto2d needed for tnkebto2d in table Oclim was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable tnpeo needed for tnpeo in table Oclim was not found in NEMO output files... skipping task
ERROR:ece2cmor3.nemo2cmor: Variable zhalfo needed for zhalfo in table Oclim was not found in NEMO output files... skipping task
treerink commented 5 years ago 
ERROR:ece2cmor3.nemo2cmor: Variable siareaacrossline     in table SImon      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable snmassacrossline     in table SImon      was not found in the NEMO output files: task skipped.  

ERROR:ece2cmor3.nemo2cmor: Variable sidivvel             in table SImon      was not found in the NEMO output files: task skipped.  sidivvel          
ERROR:ece2cmor3.nemo2cmor: Variable sishevel             in table SImon      was not found in the NEMO output files: task skipped.  sishevel
ERROR:ece2cmor3.nemo2cmor: Variable sistremax            in table SImon      was not found in the NEMO output files: task skipped.  sistremax
ERROR:ece2cmor3.nemo2cmor: Variable sistresave           in table SImon      was not found in the NEMO output files: task skipped.  sistresave
ERROR:ece2cmor3.nemo2cmor: Variable cfc11                in table Oyr        was not found in the NEMO output files: task skipped.  cfc11
ERROR:ece2cmor3.nemo2cmor: Variable difvho               in table Oyr        was not found in the NEMO output files: task skipped.  difvho
ERROR:ece2cmor3.nemo2cmor: Variable difvso               in table Oyr        was not found in the NEMO output files: task skipped.  difvso
ERROR:ece2cmor3.nemo2cmor: Variable ocontempdiff         in table Oyr        was not found in the NEMO output files: task skipped.  ocontempdiff
ERROR:ece2cmor3.nemo2cmor: Variable ocontemppadvect      in table Oyr        was not found in the NEMO output files: task skipped.  ocontemppadvect
ERROR:ece2cmor3.nemo2cmor: Variable ocontemppmdiff       in table Oyr        was not found in the NEMO output files: task skipped.  ocontemppmdiff
ERROR:ece2cmor3.nemo2cmor: Variable ocontemprmadvect     in table Oyr        was not found in the NEMO output files: task skipped.  ocontemprmadvect
ERROR:ece2cmor3.nemo2cmor: Variable ocontemptend         in table Oyr        was not found in the NEMO output files: task skipped.  ocontemptend
ERROR:ece2cmor3.nemo2cmor: Variable osaltdiff            in table Oyr        was not found in the NEMO output files: task skipped.  osaltdiff
ERROR:ece2cmor3.nemo2cmor: Variable osaltpadvect         in table Oyr        was not found in the NEMO output files: task skipped.  osaltpadvect
ERROR:ece2cmor3.nemo2cmor: Variable osaltpmdiff          in table Oyr        was not found in the NEMO output files: task skipped.  osaltpmdiff
ERROR:ece2cmor3.nemo2cmor: Variable osaltrmadvect        in table Oyr        was not found in the NEMO output files: task skipped.  osaltrmadvect
ERROR:ece2cmor3.nemo2cmor: Variable osalttend            in table Oyr        was not found in the NEMO output files: task skipped.  osalttend
ERROR:ece2cmor3.nemo2cmor: Variable somint               in table Oyr        was not found in the NEMO output files: task skipped.  somint
ERROR:ece2cmor3.nemo2cmor: Variable tnpeo                in table Oyr        was not found in the NEMO output files: task skipped.  tnpeo
ERROR:ece2cmor3.nemo2cmor: Variable diftrblo2d           in table Oclim      was not found in the NEMO output files: task skipped.  diftrblo2d
ERROR:ece2cmor3.nemo2cmor: Variable diftrelo2d           in table Oclim      was not found in the NEMO output files: task skipped.  diftrelo2d
ERROR:ece2cmor3.nemo2cmor: Variable diftrxylo2d          in table Oclim      was not found in the NEMO output files: task skipped.  diftrxylo2d
ERROR:ece2cmor3.nemo2cmor: Variable difvho               in table Oclim      was not found in the NEMO output files: task skipped.  difvho
ERROR:ece2cmor3.nemo2cmor: Variable difvmo               in table Oclim      was not found in the NEMO output files: task skipped.  difvmo
ERROR:ece2cmor3.nemo2cmor: Variable difvmto              in table Oclim      was not found in the NEMO output files: task skipped.  difvmto
ERROR:ece2cmor3.nemo2cmor: Variable difvso               in table Oclim      was not found in the NEMO output files: task skipped.  difvso
ERROR:ece2cmor3.nemo2cmor: Variable difvtrto             in table Oclim      was not found in the NEMO output files: task skipped.  difvtrto
ERROR:ece2cmor3.nemo2cmor: Variable dispkevfo            in table Oclim      was not found in the NEMO output files: task skipped.  dispkevfo
ERROR:ece2cmor3.nemo2cmor: Variable dispkexyfo2d         in table Oclim      was not found in the NEMO output files: task skipped.  dispkexyfo2d
ERROR:ece2cmor3.nemo2cmor: Variable tnkebto2d            in table Oclim      was not found in the NEMO output files: task skipped.  tnkebto2d
ERROR:ece2cmor3.nemo2cmor: Variable tnpeo                in table Oclim      was not found in the NEMO output files: task skipped.  tnpeo
ERROR:ece2cmor3.nemo2cmor: Variable zhalfo               in table Oclim      was not found in the NEMO output files: task skipped.  zhalfo

most of them seem to correspond with the error:

ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monPt   with a nemo output frequency for variable sidivvel          
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monPt   with a nemo output frequency for variable sishevel
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monPt   with a nemo output frequency for variable sistremax
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monPt   with a nemo output frequency for variable sistresave
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency yr      with a nemo output frequency for variable cfc11
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency yr      with a nemo output frequency for variable difvho
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency yr      with a nemo output frequency for variable difvso
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency yr      with a nemo output frequency for variable ocontempdiff
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency yr      with a nemo output frequency for variable ocontemppadvect
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency yr      with a nemo output frequency for variable ocontemppmdiff
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency yr      with a nemo output frequency for variable ocontemprmadvect
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency yr      with a nemo output frequency for variable ocontemptend
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency yr      with a nemo output frequency for variable osaltdiff
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency yr      with a nemo output frequency for variable osaltpadvect
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency yr      with a nemo output frequency for variable osaltpmdiff
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency yr      with a nemo output frequency for variable osaltrmadvect
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency yr      with a nemo output frequency for variable osalttend
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency yr      with a nemo output frequency for variable somint
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency yr      with a nemo output frequency for variable tnpeo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable diftrblo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable diftrelo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable diftrxylo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvho
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvmo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvmto
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvso
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvtrto
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable dispkevfo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable dispkexyfo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable tnkebto2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable tnpeo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable zhalfo

By adding the missing frequencies select_freq_files in nemo2cmor.py this problem itself seems solvable (attempt included in the optionlabel-and--messaging branch). However including the cmorisation of these additional variables I am running into other trouble, see #493. But for instance Oyr difvho does successfully cmorise now with this branch.

treerink commented 5 years ago

@oloapinivad in the branch I am able to cmorise sidivvel as well now. The results looks kind of fine (in the sense that there are fields), except for January which looks suspicious: the first month, there I see only a mask, i.e. zeros or invalid values (it is my leg 001).

treerink commented 5 years ago

A grep of all ERRORs from the piControl IFS cmorisation log gives now:

ERROR:ece2cmor3.ifs2cmor: Variable zg has unsupported combination of dimensions [u'latitude', u'plev19', u'time'] and will be skipped.
ERROR:ece2cmor3.ifs2cmor: Variable ua has unsupported combination of dimensions [u'latitude', u'plev39', u'time'] and will be skipped.
ERROR:ece2cmor3.ifs2cmor: Variable ta has unsupported combination of dimensions [u'latitude', u'plev39', u'time'] and will be skipped.
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 248.128, level type 109, level -1. Dismissing task cl in table Amon
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 246.128, level type 109, level -1. Dismissing task clw in table Amon
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 247.128, level type 109, level -1. Dismissing task cli in table Amon
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 54.128, level type 109, level -1. Dismissing task pfull in table Amon
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 130.128, level type 109, level -1. Dismissing task ta in table 6hrLev
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 131.128, level type 109, level -1. Dismissing task ua in table 6hrLev
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 132.128, level type 109, level -1. Dismissing task va in table 6hrLev
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 133.128, level type 109, level -1. Dismissing task hus in table 6hrLev
ERROR:ece2cmor3.postproc: Unsupported combination of frequency monC with time operators [u'mean within years', u'mean over years'] encountered
treerink commented 5 years ago

With the test-all-nemo-mip-variables test I am currently able to cmorise 183 NEMO variables when deactivating this list of #493. The remaining ERRORs / skipped variables are:

1. SImon siareaacrossline & SImon snmassacrossline:

ERROR:ece2cmor3.nemo2cmor: Variable siareaacrossline     in table SImon      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable snmassacrossline     in table SImon      was not found in the NEMO output files: task skipped.

2. Climatological ones (#262):

ERROR:ece2cmor3.nemo2cmor: Variable diftrblo2d           in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable diftrelo2d           in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable diftrxylo2d          in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable difvho               in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable difvmo               in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable difvmto              in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable difvso               in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable difvtrto             in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable dispkevfo            in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable dispkexyfo2d         in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable tnkebto2d            in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable tnpeo                in table Oclim      was not found in the NEMO output files: task skipped.
ERROR:ece2cmor3.nemo2cmor: Variable zhalfo               in table Oclim      was not found in the NEMO output files: task skipped.

ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable diftrblo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable diftrelo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable diftrxylo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvho
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvmo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvmto
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvso
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable difvtrto
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable dispkevfo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable dispkexyfo2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable tnkebto2d
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable tnpeo
ERROR:ece2cmor3.nemo2cmor: Could not associate cmor frequency monC    with a nemo output frequency for variable zhalfo

3. Other:

ERROR:ece2cmor3.nemo2cmor: The grid opa_grid_1point consists of a single point which is not supported, dismissing variables bigthetaoga in Omon,masso in Omon,soga in Omon,sosga in Omon,thetaoga in Omon,tosga in Omon,volo in Omon,zostoga in Omon
ERROR:ece2cmor3.nemo2cmor: The grid lim_grid_1point consists of a single point which is not supported, dismissing variables siarean in SImon,siareas in SImon,siextentn in SImon,siextents in SImon,sivoln in SImon,sivols in SImon
ERROR:ece2cmor3.nemo2cmor: Dimension ncatice could not be found in file /usr/people/reerink/mount-point-lustre-3/ec-earth-3/branch-r6874-control-output-files/t001/output/nemo/001/t001_1d_19900101_19901231_lim_grid_T_2D.nc, inserting using length-one dimension instead
ERROR:ece2cmor3.nemo2cmor: Dimension ncatice could not be found in file /usr/people/reerink/mount-point-lustre-3/ec-earth-3/branch-r6874-control-output-files/t001/output/nemo/001/t001_1m_19900101_19901231_lim_grid_T_2D.nc, inserting using length-one dimension instead
treerink commented 5 years ago

For the cmorisation of the IFS variables in the historical run, we have beside the problem with zg, ua, ta as reported in the earlier piContol post, only these additional ERRORs:

ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 43.128, level type 1, level 0. Dismissing task clayfrac in table Efx
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 43.128, level type 1, level 0. Dismissing task siltfrac in table Efx
ERROR:ece2cmor3.grib_filter: Field missing in the first day of file: code 43.128, level type 1, level 0. Dismissing task sandfrac in table Efx
treerink commented 5 years ago

Cmorising the scenario ssp5 8.5 did not give additional errors.

oloapinivad commented 5 years ago

@oloapinivad in the branch I am able to cmorise sidivvel as well now. The results looks kind of fine (in the sense that there are fields), except for January which looks suspicious: the first month, there I see only a mask, i.e. zeros or invalid values (it is my leg 001).

@treerink tested the most recent commit, I have reasonable (I mean, something that looks like sea-ice divergence only on sea-ice regions) also from the first timestep.

oloapinivad commented 5 years ago

I can confirm also 270 variables cmorized for historical AOGCM.

oloapinivad commented 5 years ago

I have been looking at the output historical AOGCM of ece2cmor3, the current list of missing variables (from a bash script plus my additional comments) is here below:

So only zonal mean and the wrongly named variables are still pending to my eye

ta 6hrLev is missing! (pressure level) ua 6hrLev is missing! (pressure level) va 6hrLev is missing! (pressure level) hus 6hrLev is missing! (pressure level) wap4 6hrPlev is missing! (wrong naming, see #462 ) zg27 6hrPlevPt is missing! (wrong naming, see #462 ) ta AERmonZ is missing! (zonal mean) cl Amon is missing! (pressure level) clw Amon is missing! (pressure level) cli Amon is missing! (pressure level) pfull Amon is missing! (pressure level) pfull CF3hr is missing! (pressure level) ta CF3hr is missing!(pressure level) ta CFmon is missing! (pressure level) hus E3hrPt is missing! (pressure level) zg EdayZ is missing! (zonal mean) ua EdayZ is missing! (zonal mean)

For NEMO the situation is a bit more complicated. There are so many pisces-related variables required that is hard to understand what is missing. Indeed, a lot seems to be the pisces one that have been excluded #486, but other are hard to see in this messy report: I highlighted a couple of them that could be missing for some other reason.

difvho Oclim is missing! difvso Oclim is missing! difvtrto Oclim is missing! tnpeo Oclim is missing! difvmo Oclim is missing! difvmto Oclim is missing! dispkevfo Oclim is missing! zhalfo Oclim is missing!

dissicos Omon is missing! talkos Omon is missing! phos Omon is missing! o2os Omon is missing! no3os Omon is missing! po4os Omon is missing! dfeos Omon is missing! chlos Omon is missing! ficeberg2d Omon is missing ("water_flux_into_sea_water_from_icebergs") hfibthermds2d Omon is missing! ("heat_flux_into_sea_water_due_to_iceberg_thermodynamics") intpp Omon is missing! intppnitrate Omon is missing! intppdiat Omon is missing! intppcalc Omon is missing! intppmisc Omon is missing! intpbfe Omon is missing! intpbsi Omon is missing! intpcalcite Omon is missing! epc100 Omon is missing! epfe100 Omon is missing! epsi100 Omon is missing! epcalc100 Omon is missing! intdic Omon is missing! spco2 Omon is missing! dpco2 Omon is missing! fgco2 Omon is missing! fgo2 Omon is missing! froc Omon is missing! intpn2 Omon is missing! fsn Omon is missing! frn Omon is missing! fsfe Omon is missing! o2min Omon is missing! zo2min Omon is missing! zooc Omon is missing! zmicro Omon is missing! talk Omon is missing! ph Omon is missing! o2 Omon is missing! chl Omon is missing!

dissic Oyr is missing! dissoc Oyr is missing! zooc Oyr is missing! detoc Oyr is missing! calc Oyr is missing! phydiat Oyr is missing! phymisc Oyr is missing! zmicro Oyr is missing! zmeso Oyr is missing! talk Oyr is missing! ph Oyr is missing! o2 Oyr is missing! no3 Oyr is missing! nh4 Oyr is missing! po4 Oyr is missing! dfe Oyr is missing! si Oyr is missing! chl Oyr is missing! co3 Oyr is missing! co3satcalc Oyr is missing! pp Oyr is missing! pnitrate Oyr is missing! pbfe Oyr is missing! pbsi Oyr is missing! pcalc Oyr is missing! expc Oyr is missing! expn Oyr is missing! expp Oyr is missing! dcalc Oyr is missing! graz Oyr is missing! fgco2 Oyr is missing!

For the two highlighted, there was a discussion on the portal suggesting they should be removed, but it is there is no update on this. https://dev.ec-earth.org/issues/609

Hope this helps Cheers, P

treerink commented 5 years ago

@oloapinivad I see here a lot of PISCES variables, and actually these shouldn't be there anymore, as this is solved. Because I see you did update for ece2cmor v1.1.1 (you reported to be able to cmorise for instance sidivvel), my guess is that you maybe did not use the latest json data request file:

cmip6-output-control-files/CMIP/EC-EARTH-AOGCM/cmip6-experiment-CMIP-historical/cmip6-data-request-varlist-CMIP-historical-EC-EARTH-AOGCM.json

from the latest revision (r6951 or later) in the r6874-control-output-files branch, see ece portal issue 659-29. Could that be?

oloapinivad commented 5 years ago

Oh! I missed that update, thanks for pointing it out, since I am running - the simulation - with the r6903. With the current update it reads:

This fits your posts above, great!

treerink commented 5 years ago

Closing this issue, for the current status check #500.