search

ACCESS-NRI / ESMValTool-workflow

2 stars 1 forks source link

ESGF Invalid Query parameters #97

Closed rbeucher closed 1 year ago

rbeucher commented 1 year ago

Currently affecting the following recipes:

recipe_autoassess_landsurface_surfrad.out: raise Exception("Invalid query parameter(s): %s" % content) recipe_clouds_ipcc.out:Exception: Invalid query parameter(s): recipe_cmug_h2o.out:Exception: Invalid query parameter(s): recipe_deangelis15nat.out:Exception: Invalid query parameter(s): recipe_flato13ipcc_figures_92_95.out:Exception: Invalid query parameter(s): recipe_lauer13jclim.out:Exception: Invalid query parameter(s): recipe_perfmetrics_CMIP5.out:Exception: Invalid query parameter(s): recipe_validation.out:Exception: Invalid query parameter(s): recipe_wenzel16jclim.out:Exception: Invalid query parameter(s):

rbeucher commented 1 year ago

CERES-EBAF&time_frequency= empty seems to be the pb

It is affecting:

recipe_autoassess_landsurface_surfrad recipe_clouds_ipcc recipe_cmug_h2o recipe_deangelis15nat recipe_flato13ipcc_figures_92_95 recipe_lauer13jclim recipe_perfmetrics_CMIP5 recipe_validation recipe_wenzel16jclim

which is all of the recipes initially listed

rbeucher commented 1 year ago

Now CERES-EBAF should be in

/g/data/kj13/datasets/esmvaltool/obsdata-v2/Tier1/CERES-EBAF

rbeucher commented 1 year ago

see https://github.com/ESMValGroup/ESMValTool/issues/2974

rbeucher commented 1 year ago

https://github.com/ESMValGroup/ESMValCore/issues/2142

rbeucher commented 1 year ago

Fixed the drs for obs4mips. recipe_validation is now passing. Running the other recipes now. For some reason the file format expected was wrong.

I change from:

obs4MIPs:
  cmor_strict: false
  input_dir:
    default: 'Tier{tier}/{dataset}'
    NCI: '*/{dataset}/atmos/{frequency}/*'
    RCAST: '/'
  input_file: '{short_name}_{dataset}_{level}_{version}_*.nc'
  output_file: '{project}_{dataset}_{level}_{version}_{short_name}'
  cmor_type: 'CMIP6'
  cmor_path: 'obs4mips'
  cmor_default_table_prefix: 'obs4mips_'

to

obs4MIPs:
  cmor_strict: false
  input_dir:
    default: 'Tier{tier}/{dataset}'
    ESGF: '{project}/{dataset}/{version}'
    NCI: '*/{dataset}/atmos/{frequency}/*'
    RCAST: '/'
  input_file: 
    default: '{short_name}_*.nc'
    ESGF: '{short_name}_*.nc'
  output_file: '{project}_{dataset}_{short_name}'
  cmor_type: 'CMIP6'
  cmor_path: 'obs4mips'
  cmor_default_table_prefix: 'obs4MIPs_'