Open charliepascoe opened 3 years ago
Wrong MIP Table name (Aday10Pt should be A10dayPt) Starting file bry_Aday10Pt_NIWA-UKCA2_refD1_r1i1p1f1_gn_200501-201812.nc C4.001.001: [parse_filename]: OK C4.001.002: [parse_filename_timerange]: OK C4.001.004: [file_name_extra]: OK C4.002.001: [global_ncattribute_present]: OK Exception has occured Traceback (most recent call last): File "/home/badc/miniconda3/envs/ingest_py3/lib/python3.8/site-packages/ceda_cc/utils_c4.py", line 261, in runChecks c() # run check File "/home/badc/miniconda3/envs/ingest_py3/lib/python3.8/site-packages/ceda_cc/utils_c4.py", line 592, in do_check_ga self.test( vocabs['variable'].isInTable( varName, varGroup ), msg, abort=True, part=True ) File "/home/badc/miniconda3/envs/ingest_py3/lib/python3.8/site-packages/ceda_cc/ceda_cc_config/utils_config.py", line 250, in isInTable assert vg in list(self.varcons.keys()), '%s not found in self.varcons.keys() [%s]' % (vg,str(list(self.varcons.keys())) ) AssertionError: Aday10Pt not found in self.varcons.keys() [['A10dayPt', 'Aday', 'AdayZ', 'Amon', 'AmonZ', 'fx']] C4.100.001: [exception]: FAILED:: Exception has occured Traceback (most recent call last): File "/home/badc/miniconda3/envs/ingest_py3/lib/python3.8/site-packages/ceda_cc/utils_c4.py", line 261, in runChecks c() # run check File "/home/badc/miniconda3/envs/ingest_py3/lib/python3.8/site-packages/ceda_cc/utils_c4.py", line 592, in do_check_ga self.test( vocabs['variable'].isInTable( varName, varGroup ), msg, abort=True, part=True ) File "/home/badc/miniconda3/envs/ingest_py3/lib/python3.8/site-packages/ceda_cc/ceda_cc_config/utils_config.py", line 250, in isInTable assert vg in list(self.varcons.keys()), '%s not found in self.varcons.keys() [%s]' % (vg,str(list(self.varcons.keys())) ) AssertionError: Aday10Pt not found in self.varcons.keys() [['A10dayPt', 'Aday', 'AdayZ', 'Amon', 'AmonZ', 'fx']]
During handling of the above exception, another exception occurred:
Traceback (most recent call last): File "/home/badc/miniconda3/envs/ingest_py3/lib/python3.8/site-packages/ceda_cc/c4_run.py", line 339, in run self.cc.checkFile( f, log=fLogger,attributeMappings=self.c4i.attributeMappings, getdrs=self.c4i.getdrs ) File "/home/badc/miniconda3/envs/ingest_py3/lib/python3.8/site-packages/ceda_cc/c4_run.py", line 230, in checkFile self.cga.check( self.ga, self.va, self.cfn.var, vGroup, self.vocabs, self.cfn.fnParts ) File "/home/badc/miniconda3/envs/ingest_py3/lib/python3.8/site-packages/ceda_cc/utils_c4.py", line 495, in check self.runChecks() File "/home/badc/miniconda3/envs/ingest_py3/lib/python3.8/site-packages/ceda_cc/utils_c4.py", line 270, in runChecks raise loggedException ceda_cc.xceptions.loggedException
error count 3 example 2021-06-28 17:09:27,486 INFO Starting batch -- number of file: 1 2021-06-28 17:09:27,486 INFO Source: /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/ua_Amon_NIWA-UKCA2_refD1_r1i1p1f1_gn_196001-201812.nc 2021-06-28 17:09:27,486 INFO Command: /home/badc/miniconda3/envs/ingest_py3/bin/ceda-cc -p ccmi2022 -f /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/ua_Amon_NIWA-UKCA2_refD1_r1i1p1f1_gn_196001-201812.nc 2021-06-28 17:09:27,499 INFO Python netcdf: netCDF4 2021-06-28 17:09:27,499 INFO Starting: ua_Amon_NIWA-UKCA2_refD1_r1i1p1f1_gn_196001-201812.nc 2021-06-28 17:09:27,499 INFO Starting file ua_Amon_NIWA-UKCA2_refD1_r1i1p1f1_gn_196001-201812.nc 2021-06-28 17:09:27,500 INFO C4.001.001: [parse_filename]: OK 2021-06-28 17:09:27,500 INFO C4.001.002: [parse_filename_timerange]: OK 2021-06-28 17:09:27,500 INFO C4.001.004: [file_name_extra]: OK 2021-06-28 17:09:27,595 INFO C4.002.001: [global_ncattribute_present]: OK 2021-06-28 17:09:27,595 INFO C4.002.003: [variable_type]: OK 2021-06-28 17:09:27,595 INFO C4.002.004: [variable_ncattribute_present]: OK 2021-06-28 17:09:27,595 INFO C4.002.005: [variable_ncattribute_mipvalues]: OK 2021-06-28 17:09:27,595 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: _FillValue must be present if missing_value is [ua] 2021-06-28 17:09:27,596 ERROR C4.002.006: [global_ncattribute_cv]: FAILED:: Global attributes do not match constraints: [('product', 'model_output', "['model-output']"), ('realization_index', '1', "Value is not instance o f required class: 1 -- <class 'str'>"), ('initialization_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('physics_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('forcing_index', '1', "Value is not instance of required class: 1 -- <class 'str'>")] 2021-06-28 17:09:27,596 ERROR C4.002.007: [filename_filemetadata_consistency]: FAILED:: File name segments do not match corresponding global attributes: [(4, 'grid_label'), (5, 'variant_label'), (6, '@variant:5:')] 2021-06-28 17:09:27,596 INFO C4.003.001: [time_attributes]: OK 2021-06-28 17:09:27,596 INFO Done -- error count 3
testing aborted: pa_Amon_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:07:48,388 INFO Starting batch -- number of file: 1 2021-06-28 17:07:48,388 INFO Source: /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/pa_Amon_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:07:48,388 INFO Command: /home/badc/miniconda3/envs/ingest_py3/bin/ceda-cc -p ccmi2022 -f /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/pa_Amon_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:07:48,396 INFO Python netcdf: netCDF4 2021-06-28 17:07:48,396 INFO Starting: pa_Amon_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:07:48,396 INFO Starting file pa_Amon_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:07:48,396 INFO C4.001.001: [parse_filename]: OK 2021-06-28 17:07:48,396 INFO C4.001.002: [parse_filename_timerange]: OK 2021-06-28 17:07:48,396 INFO C4.001.004: [file_name_extra]: OK 2021-06-28 17:07:48,448 INFO C4.002.001: [global_ncattribute_present]: OK 2021-06-28 17:07:48,449 ERROR C4.002.002: [variable_in_group]: FAILED:: Variable pa not in table Amon 2021-06-28 17:07:48,449 INFO C4.002.xxx: ABORTED:: Errors too severe to complete further checks in this module 2021-06-28 17:07:48,449 INFO Done -- testing aborted because of severity of errors
testing aborted: ta500_Aday_NIWA-UKCA2_refD1_r1i1p1f1_gn_196001-201812.nc 2021-06-28 17:08:17,312 INFO Starting batch -- number of file: 1 2021-06-28 17:08:17,312 INFO Source: /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/ta500_Aday_NIWA-UKCA2_refD1_r1i1p1f1_gn_196001-201812.nc 2021-06-28 17:08:17,312 INFO Command: /home/badc/miniconda3/envs/ingest_py3/bin/ceda-cc -p ccmi2022 -f /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/ta500_Aday_NIWA-UKCA2_refD1_r1i1p1f1_gn_196001-201812.nc 2021-06-28 17:08:17,322 INFO Python netcdf: netCDF4 2021-06-28 17:08:17,322 INFO Starting: ta500_Aday_NIWA-UKCA2_refD1_r1i1p1f1_gn_196001-201812.nc 2021-06-28 17:08:17,323 INFO Starting file ta500_Aday_NIWA-UKCA2_refD1_r1i1p1f1_gn_196001-201812.nc 2021-06-28 17:08:17,323 INFO C4.001.001: [parse_filename]: OK 2021-06-28 17:08:17,323 INFO C4.001.002: [parse_filename_timerange]: OK 2021-06-28 17:08:17,323 INFO C4.001.004: [file_name_extra]: OK 2021-06-28 17:08:17,398 INFO C4.002.001: [global_ncattribute_present]: OK 2021-06-28 17:08:17,398 INFO C4.002.003: [variable_type]: OK 2021-06-28 17:08:17,398 INFO C4.002.004: [variable_ncattribute_present]: OK 2021-06-28 17:08:17,398 INFO C4.002.005: [variable_ncattribute_mipvalues]: OK 2021-06-28 17:08:17,398 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: _FillValue must be present if missing_value is [ta500] 2021-06-28 17:08:17,398 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: Variable [ta500] has incorrect attributes: cell_methods="area: mean time: instantaneous" [correct: "area: mean time: point"] 2021-06-28 17:08:17,398 ERROR C4.002.006: [global_ncattribute_cv]: FAILED:: Global attributes do not match constraints: [('frequency', 'day', "['10dayPt', 'dayPt', 'fx', 'mon']"), ('product', 'model_output', "['model-outp ut']"), ('realization_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('initialization_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('physics_index', '1', "Valu e is not instance of required class: 1 -- <class 'str'>"), ('forcing_index', '1', "Value is not instance of required class: 1 -- <class 'str'>")] 2021-06-28 17:08:17,398 ERROR C4.002.007: [filename_filemetadata_consistency]: FAILED:: File name segments do not match corresponding global attributes: [(4, 'grid_label'), (5, 'variant_label'), (6, '@variant:5:')] 2021-06-28 17:08:17,399 INFO C4.003.001: [time_attributes]: OK 2021-06-28 17:08:17,399 ERROR C4.003.002: [pressure_levels]: FAILED:: plev coordinate not found ['time_bnds', 'lat_bnds', 'lon_bnds', 'ta500'] 2021-06-28 17:08:17,399 INFO C4.003.xxx: ABORTED:: Errors too severe to complete further checks in this module 2021-06-28 17:08:17,399 INFO Done -- testing aborted because of severity of errors
testing aborted: ta500_Aday_NIWA-UKCA2_refD1_r3i1p1f1_gn_196001-201812.nc 2021-06-28 17:08:18,256 INFO Starting batch -- number of file: 1 2021-06-28 17:08:18,256 INFO Source: /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/ta500_Aday_NIWA-UKCA2_refD1_r3i1p1f1_gn_196001-201812.nc 2021-06-28 17:08:18,256 INFO Command: /home/badc/miniconda3/envs/ingest_py3/bin/ceda-cc -p ccmi2022 -f /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/ta500_Aday_NIWA-UKCA2_refD1_r3i1p1f1_gn_196001-201812.nc 2021-06-28 17:08:18,265 INFO Python netcdf: netCDF4 2021-06-28 17:08:18,265 INFO Starting: ta500_Aday_NIWA-UKCA2_refD1_r3i1p1f1_gn_196001-201812.nc 2021-06-28 17:08:18,265 INFO Starting file ta500_Aday_NIWA-UKCA2_refD1_r3i1p1f1_gn_196001-201812.nc 2021-06-28 17:08:18,265 INFO C4.001.001: [parse_filename]: OK 2021-06-28 17:08:18,265 INFO C4.001.002: [parse_filename_timerange]: OK 2021-06-28 17:08:18,265 INFO C4.001.004: [file_name_extra]: OK 2021-06-28 17:08:18,341 INFO C4.002.001: [global_ncattribute_present]: OK 2021-06-28 17:08:18,341 INFO C4.002.003: [variable_type]: OK 2021-06-28 17:08:18,341 INFO C4.002.004: [variable_ncattribute_present]: OK 2021-06-28 17:08:18,341 INFO C4.002.005: [variable_ncattribute_mipvalues]: OK 2021-06-28 17:08:18,341 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: _FillValue must be present if missing_value is [ta500] 2021-06-28 17:08:18,341 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: Variable [ta500] has incorrect attributes: cell_methods="area: mean time: instantaneous" [correct: "area: mean time: point"] 2021-06-28 17:08:18,342 ERROR C4.002.006: [global_ncattribute_cv]: FAILED:: Global attributes do not match constraints: [('frequency', 'day', "['10dayPt', 'dayPt', 'fx', 'mon']"), ('product', 'model_output', "['model-outp ut']"), ('realization_index', '3', "Value is not instance of required class: 3 -- <class 'str'>"), ('initialization_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('physics_index', '1', "Valu e is not instance of required class: 1 -- <class 'str'>"), ('forcing_index', '1', "Value is not instance of required class: 1 -- <class 'str'>")] 2021-06-28 17:08:18,342 ERROR C4.002.007: [filename_filemetadata_consistency]: FAILED:: File name segments do not match corresponding global attributes: [(4, 'grid_label'), (5, 'variant_label'), (6, '@variant:5:')] 2021-06-28 17:08:18,342 INFO C4.003.001: [time_attributes]: OK 2021-06-28 17:08:18,342 ERROR C4.003.002: [pressure_levels]: FAILED:: plev coordinate not found ['time_bnds', 'lat_bnds', 'lon_bnds', 'ta500'] 2021-06-28 17:08:18,342 INFO C4.003.xxx: ABORTED:: Errors too severe to complete further checks in this module 2021-06-28 17:08:18,342 INFO Done -- testing aborted because of severity of errors
testing aborted: tas_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:08:36,224 INFO Starting batch -- number of file: 1 2021-06-28 17:08:36,224 INFO Source: /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/tas_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:08:36,224 INFO Command: /home/badc/miniconda3/envs/ingest_py3/bin/ceda-cc -p ccmi2022 -f /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/tas_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:08:36,233 INFO Python netcdf: netCDF4 2021-06-28 17:08:36,233 INFO Starting: tas_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:08:36,233 INFO Starting file tas_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:08:36,233 INFO C4.001.001: [parse_filename]: OK 2021-06-28 17:08:36,233 INFO C4.001.002: [parse_filename_timerange]: OK 2021-06-28 17:08:36,233 INFO C4.001.004: [file_name_extra]: OK 2021-06-28 17:08:36,314 INFO C4.002.001: [global_ncattribute_present]: OK 2021-06-28 17:08:36,314 INFO C4.002.003: [variable_type]: OK 2021-06-28 17:08:36,314 INFO C4.002.004: [variable_ncattribute_present]: OK 2021-06-28 17:08:36,315 INFO C4.002.005: [variable_ncattribute_mipvalues]: OK 2021-06-28 17:08:36,315 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: _FillValue must be present if missing_value is [tas] 2021-06-28 17:08:36,315 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: Variable [tas] has incorrect attributes: cell_methods="area: mean time: instantaneous" [correct: "area: mean time: point"] 2021-06-28 17:08:36,315 ERROR C4.002.006: [global_ncattribute_cv]: FAILED:: Global attributes do not match constraints: [('frequency', 'day', "['10dayPt', 'dayPt', 'fx', 'mon']"), ('product', 'model_output', "['model-outp ut']"), ('realization_index', '2', "Value is not instance of required class: 2 -- <class 'str'>"), ('initialization_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('physics_index', '1', "Valu e is not instance of required class: 1 -- <class 'str'>"), ('forcing_index', '1', "Value is not instance of required class: 1 -- <class 'str'>")] 2021-06-28 17:08:36,315 ERROR C4.002.007: [filename_filemetadata_consistency]: FAILED:: File name segments do not match corresponding global attributes: [(4, 'grid_label'), (5, 'variant_label'), (6, '@variant:5:')] 2021-06-28 17:08:36,315 INFO C4.003.001: [time_attributes]: OK 2021-06-28 17:08:36,315 ERROR C4.003.003: [height_levels]: FAILED:: height coordinate not found ['time_bnds', 'lat_bnds', 'lon_bnds', 'tas'] 2021-06-28 17:08:36,315 INFO C4.003.xxx: ABORTED:: Errors too severe to complete further checks in this module 2021-06-28 17:08:36,315 INFO Done -- testing aborted because of severity of errors
testing aborted: ua500_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:09:19,065 INFO Starting batch -- number of file: 1 2021-06-28 17:09:19,065 INFO Source: /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/ua500_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:09:19,065 INFO Command: /home/badc/miniconda3/envs/ingest_py3/bin/ceda-cc -p ccmi2022 -f /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/ua500_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:09:19,072 INFO Python netcdf: netCDF4 2021-06-28 17:09:19,072 INFO Starting: ua500_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:09:19,072 INFO Starting file ua500_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:09:19,072 INFO C4.001.001: [parse_filename]: OK 2021-06-28 17:09:19,072 INFO C4.001.002: [parse_filename_timerange]: OK 2021-06-28 17:09:19,072 INFO C4.001.004: [file_name_extra]: OK 2021-06-28 17:09:19,142 INFO C4.002.001: [global_ncattribute_present]: OK 2021-06-28 17:09:19,142 INFO C4.002.003: [variable_type]: OK 2021-06-28 17:09:19,142 INFO C4.002.004: [variable_ncattribute_present]: OK 2021-06-28 17:09:19,142 INFO C4.002.005: [variable_ncattribute_mipvalues]: OK 2021-06-28 17:09:19,142 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: _FillValue must be present if missing_value is [ua500] 2021-06-28 17:09:19,142 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: Variable [ua500] has incorrect attributes: cell_methods="area: mean time: instantaneous" [correct: "area: mean time: point"] 2021-06-28 17:09:19,142 ERROR C4.002.006: [global_ncattribute_cv]: FAILED:: Global attributes do not match constraints: [('frequency', 'day', "['10dayPt', 'dayPt', 'fx', 'mon']"), ('product', 'model_output', "['model-outp ut']"), ('realization_index', '2', "Value is not instance of required class: 2 -- <class 'str'>"), ('initialization_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('physics_index', '1', "Valu e is not instance of required class: 1 -- <class 'str'>"), ('forcing_index', '1', "Value is not instance of required class: 1 -- <class 'str'>")] 2021-06-28 17:09:19,143 ERROR C4.002.007: [filename_filemetadata_consistency]: FAILED:: File name segments do not match corresponding global attributes: [(4, 'grid_label'), (5, 'variant_label'), (6, '@variant:5:')] 2021-06-28 17:09:19,143 INFO C4.003.001: [time_attributes]: OK 2021-06-28 17:09:19,143 ERROR C4.003.002: [pressure_levels]: FAILED:: plev coordinate not found ['time_bnds', 'lat_bnds', 'lon_bnds', 'ua500'] 2021-06-28 17:09:19,143 INFO C4.003.xxx: ABORTED:: Errors too severe to complete further checks in this module 2021-06-28 17:09:19,143 INFO Done -- testing aborted because of severity of errors
testing aborted:va500_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:09:34,063 INFO Starting batch -- number of file: 1 2021-06-28 17:09:34,063 INFO Source: /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/va500_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:09:34,063 INFO Command: /home/badc/miniconda3/envs/ingest_py3/bin/ceda-cc -p ccmi2022 -f /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/va500_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:09:34,072 INFO Python netcdf: netCDF4 2021-06-28 17:09:34,072 INFO Starting: va500_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:09:34,072 INFO Starting file va500_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:09:34,072 INFO C4.001.001: [parse_filename]: OK 2021-06-28 17:09:34,072 INFO C4.001.002: [parse_filename_timerange]: OK 2021-06-28 17:09:34,072 INFO C4.001.004: [file_name_extra]: OK 2021-06-28 17:09:34,141 INFO C4.002.001: [global_ncattribute_present]: OK 2021-06-28 17:09:34,141 INFO C4.002.003: [variable_type]: OK 2021-06-28 17:09:34,142 INFO C4.002.004: [variable_ncattribute_present]: OK 2021-06-28 17:09:34,142 INFO C4.002.005: [variable_ncattribute_mipvalues]: OK 2021-06-28 17:09:34,142 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: _FillValue must be present if missing_value is [va500] 2021-06-28 17:09:34,142 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: Variable [va500] has incorrect attributes: cell_methods="area: mean time: instantaneous" [correct: "area: mean time: point"] 2021-06-28 17:09:34,142 ERROR C4.002.006: [global_ncattribute_cv]: FAILED:: Global attributes do not match constraints: [('frequency', 'day', "['10dayPt', 'dayPt', 'fx', 'mon']"), ('product', 'model_output', "['model-outp ut']"), ('realization_index', '2', "Value is not instance of required class: 2 -- <class 'str'>"), ('initialization_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('physics_index', '1', "Valu e is not instance of required class: 1 -- <class 'str'>"), ('forcing_index', '1', "Value is not instance of required class: 1 -- <class 'str'>")] 2021-06-28 17:09:34,142 ERROR C4.002.007: [filename_filemetadata_consistency]: FAILED:: File name segments do not match corresponding global attributes: [(4, 'grid_label'), (5, 'variant_label'), (6, '@variant:5:')] 2021-06-28 17:09:34,142 INFO C4.003.001: [time_attributes]: OK 2021-06-28 17:09:34,142 ERROR C4.003.002: [pressure_levels]: FAILED:: plev coordinate not found ['time_bnds', 'lat_bnds', 'lon_bnds', 'va500'] 2021-06-28 17:09:34,142 INFO C4.003.xxx: ABORTED:: Errors too severe to complete further checks in this module 2021-06-28 17:09:34,142 INFO Done -- testing aborted because of severity of errors
testing aborted:zg500_Aday_NIWA-UKCA2_refD1_r1i1p1f1_gn_196001-201812.nc 2021-06-28 17:10:03,923 INFO Starting batch -- number of file: 1 2021-06-28 17:10:03,923 INFO Source: /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/zg500_Aday_NIWA-UKCA2_refD1_r1i1p1f1_gn_196001-201812.nc 2021-06-28 17:10:03,923 INFO Command: /home/badc/miniconda3/envs/ingest_py3/bin/ceda-cc -p ccmi2022 -f /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/zg500_Aday_NIWA-UKCA2_refD1_r1i1p1f1_gn_196001-201812.nc 2021-06-28 17:10:03,931 INFO Python netcdf: netCDF4 2021-06-28 17:10:03,931 INFO Starting: zg500_Aday_NIWA-UKCA2_refD1_r1i1p1f1_gn_196001-201812.nc 2021-06-28 17:10:03,932 INFO Starting file zg500_Aday_NIWA-UKCA2_refD1_r1i1p1f1_gn_196001-201812.nc 2021-06-28 17:10:03,932 INFO C4.001.001: [parse_filename]: OK 2021-06-28 17:10:03,932 INFO C4.001.002: [parse_filename_timerange]: OK 2021-06-28 17:10:03,932 INFO C4.001.004: [file_name_extra]: OK 2021-06-28 17:10:03,992 INFO C4.002.001: [global_ncattribute_present]: OK 2021-06-28 17:10:03,992 INFO C4.002.003: [variable_type]: OK 2021-06-28 17:10:03,992 INFO C4.002.004: [variable_ncattribute_present]: OK 2021-06-28 17:10:03,992 INFO C4.002.005: [variable_ncattribute_mipvalues]: OK 2021-06-28 17:10:03,992 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: _FillValue must be present if missing_value is [zg500] 2021-06-28 17:10:03,993 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: Variable [zg500] has incorrect attributes: cell_methods="area: mean time: instantaneous" [correct: "area: mean time: point"] 2021-06-28 17:10:03,993 ERROR C4.002.006: [global_ncattribute_cv]: FAILED:: Global attributes do not match constraints: [('frequency', 'day', "['10dayPt', 'dayPt', 'fx', 'mon']"), ('product', 'model_output', "['model-outp ut']"), ('realization_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('initialization_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('physics_index', '1', "Valu e is not instance of required class: 1 -- <class 'str'>"), ('forcing_index', '1', "Value is not instance of required class: 1 -- <class 'str'>")] 2021-06-28 17:10:03,993 ERROR C4.002.007: [filename_filemetadata_consistency]: FAILED:: File name segments do not match corresponding global attributes: [(4, 'grid_label'), (5, 'variant_label'), (6, '@variant:5:')] 2021-06-28 17:10:03,993 INFO C4.003.001: [time_attributes]: OK 2021-06-28 17:10:03,993 ERROR C4.003.002: [pressure_levels]: FAILED:: plev coordinate not found ['time_bnds', 'lat_bnds', 'lon_bnds', 'zg500'] 2021-06-28 17:10:03,993 INFO C4.003.xxx: ABORTED:: Errors too severe to complete further checks in this module 2021-06-28 17:10:03,993 INFO Done -- testing aborted because of severity of errors
testing aborted: zg500_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:10:04,449 INFO Starting batch -- number of file: 1 2021-06-28 17:10:04,450 INFO Source: /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/zg500_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:10:04,450 INFO Command: /home/badc/miniconda3/envs/ingest_py3/bin/ceda-cc -p ccmi2022 -f /datacentre/arrivals/users/omorgenstern/ccmi-2022/v20210625/zg500_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:10:04,458 INFO Python netcdf: netCDF4 2021-06-28 17:10:04,458 INFO Starting: zg500_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:10:04,458 INFO Starting file zg500_Aday_NIWA-UKCA2_refD1_r2i1p1f1_gn_196001-201812.nc 2021-06-28 17:10:04,458 INFO C4.001.001: [parse_filename]: OK 2021-06-28 17:10:04,458 INFO C4.001.002: [parse_filename_timerange]: OK 2021-06-28 17:10:04,458 INFO C4.001.004: [file_name_extra]: OK 2021-06-28 17:10:04,559 INFO C4.002.001: [global_ncattribute_present]: OK 2021-06-28 17:10:04,560 INFO C4.002.003: [variable_type]: OK 2021-06-28 17:10:04,560 INFO C4.002.004: [variable_ncattribute_present]: OK 2021-06-28 17:10:04,560 INFO C4.002.005: [variable_ncattribute_mipvalues]: OK 2021-06-28 17:10:04,560 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: _FillValue must be present if missing_value is [zg500] 2021-06-28 17:10:04,560 ERROR C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: Variable [zg500] has incorrect attributes: cell_methods="area: mean time: instantaneous" [correct: "area: mean time: point"] 2021-06-28 17:10:04,560 ERROR C4.002.006: [global_ncattribute_cv]: FAILED:: Global attributes do not match constraints: [('frequency', 'day', "['10dayPt', 'dayPt', 'fx', 'mon']"), ('product', 'model_output', "['model-outp ut']"), ('realization_index', '2', "Value is not instance of required class: 2 -- <class 'str'>"), ('initialization_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('physics_index', '1', "Valu e is not instance of required class: 1 -- <class 'str'>"), ('forcing_index', '1', "Value is not instance of required class: 1 -- <class 'str'>")] 2021-06-28 17:10:04,560 ERROR C4.002.007: [filename_filemetadata_consistency]: FAILED:: File name segments do not match corresponding global attributes: [(4, 'grid_label'), (5, 'variant_label'), (6, '@variant:5:')] 2021-06-28 17:10:04,560 INFO C4.003.001: [time_attributes]: OK 2021-06-28 17:10:04,560 ERROR C4.003.002: [pressure_levels]: FAILED:: plev coordinate not found ['time_bnds', 'lat_bnds', 'lon_bnds', 'zg500'] 2021-06-28 17:10:04,560 INFO C4.003.xxx: ABORTED:: Errors too severe to complete further checks in this module 2021-06-28 17:10:04,560 INFO Done -- testing aborted because of severity of errors
error count 4 example Starting file br_AmonZ_NIWA-UKCA2_refD1_r2i1p1f1_gnz_196001-201812.nc C4.001.001: [parse_filename]: OK C4.001.002: [parse_filename_timerange]: OK C4.001.004: [file_name_extra]: OK C4.002.001: [global_ncattribute_present]: OK C4.002.003: [variable_type]: OK C4.002.004: [variable_ncattribute_present]: OK C4.002.005: [variable_ncattribute_mipvalues]: OK C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: _FillValue must be present if missing_value is [br] C4.002.005: [variable_ncattribute_mipvalues]: FAILED:: Variable [br] has incorrect attributes: cell_methods="area: time: mean" [correct: "longitude: mean time: mean"] C4.002.006: [global_ncattribute_cv]: FAILED:: Global attributes do not match constraints: [('product', 'model_output', "['model-output']"), ('realization_index', '2', "Value is not instance of required class: 2 -- <class 'str'>"), ('initialization_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('physics_index', '1', "Value is not instance of required class: 1 -- <class 'str'>"), ('forcing_index', '1', "Value is not instance of required class: 1 -- <class 'str'>")] C4.002.007: [filename_filemetadata_consistency]: FAILED:: File name segments do not match corresponding global attributes: [(4, 'grid_label'), (5, 'variant_label'), (6, '@variant:5:')] C4.003.001: [time_attributes]: OK Done -- error count 4