Validation is turned off for the data files in this repo

[shlyaeva]

Current behavior (describe the bug)

I was looking at how validation of test data is configured in this repository, and realized it's probably turned off by using flags to ignore warnings and errors:

https://github.com/JCSDA-internal/ufo-data/blob/4d4f22e2ddd04d0349e0b92fa134ac6c0eddb4ab/CMakeLists.txt#L53-L54

When ready, I think it may be good to remove these flags to turn on the obs file validation.

[PatNichols]

@shlyaeva Maybe it's my ignorance talking but how do we want to validate it? If the files are messed up then the associated ctests for ufo will fail I would think. Actually have ctests here is a little redundant or am i missing something basic?

[shlyaeva]

Actually if you turn the validation on, it fails for a lot of files, because even though ufo tests work, files themselves don't comply with ioda convention. I did a bit of looking into it with fv3-jedi obs data and decided that it would be a lot of work to make files comply unless there's a utility that can do it.

[srherbener]

I'm thinking that the latest ioda upgrader (ioda-upgrade-v2-to-v3.x) was run on the files to get them to the state they are in now. In an ideal world, that should have brought the files into compliance, but apparently this is not true.

The upgrader uses the ioda ObsSpace.yaml file (ioda/share/ioda/yaml/validation/ObsSpace.yaml) for guidance on how to rename variables, and I suspect that the ObsSpace.yaml file has changed a lot since the last time the upgrader was run on these files. It might be effective to try running the upgrader again on the files that fail the validator (which also uses the same ObsSpace.yaml file).

If that doesn't get the job done, but is close, we might be able to modify the upgrader to take care of the remaining issues.

[PatNichols]

@srherbener Is there been any change on this issue. Perhaps we can do a sprint or something similar to fix this, or will a conventional PR fix it?

[srherbener]

I am not aware of any work that has been done on this. I think we should address this in a coordinated effort as you are suggesting.

I think we are running the validator on ioda-converter outputs and those are actually being checked. We should double check this, and if so then I think it would be sufficient to fix the ufo-data files by whatever means is the easiest.

[gthompsnJCSDA]

This is a piece of pretty major technical debt. A lot of time was spent by myself and others to get us far along with matching conventions, but as the months of code sprinting went on, it became obvious that more work would be required. The best suggestion I have is to create a list of files with errors and warnings and see how big the problem is, then plan a code sprint to clean this up. If we can achieve the end state, then we should never again allow new files added without passing the validator - which we shouldn't actually be doing now either - as code reviewers.

[PatNichols]

@srherbener @gthompsnJCSDA agreed. That would be the best way to go.

[PatNichols]

@srherbener @gthompsnJCSDA @shlyaeva When these flags are removed and using UFO_TEST_TIER=2 for the ufo-bundle, I see 314 test failures on my RedHat instance. When these flags are present, all ctests pass.

[PatNichols]

@BenjaminRuston @gthompsnJCSDA @shlyaeva Looks like this might be a future sprint.

[srherbener]

@srherbener @gthompsnJCSDA @shlyaeva When these flags are removed and using UFO_TEST_TIER=2 for the ufo-bundle, I see 314 test failures on my RedHat instance. When these flags are present, all ctests pass.

Wow! I agree that this could be handled in a future code sprint. I think when Ryan was here and he conducted a code sprint to update UFO to the JEDI convention names, they saw these (or a subset of these) failures from the validator and made the decision to address the validator failures later. I guess it's that time now.

[PatNichols]

If anyone is needing a list of failures here it is ( this is just removing --ignore-errors). There are currently 286 failures.

1043:ufo_data_validate_2020100106_metars_small.nc 1045:ufo_data_validate_Jason-2-2018-04-15.nc 1046:ufo_data_validate_PStar_obs_20210521T1200Z.nc4 1047:ufo_data_validate_PStar_obs_20210521T1200Z_noflag.nc4 1048:ufo_data_validate_QFEtoQNH_obs_20210521T1200Z.nc4 1049:ufo_data_validate_RadToBT_obs_2021071200.nc4 1050:ufo_data_validate_Rcov_iasi_metop-b_sea.nc4 1051:ufo_data_validate_T2potentialT_conversion_aircraft.nc4 1052:ufo_data_validate_abi_g16_obs_2018041500_m_qc.nc4 1053:ufo_data_validate_abi_g16_obs_2019042306_m.nc4 1054:ufo_data_validate_ahi_himawari8_obs_2019042306_m.nc4 1055:ufo_data_validate_ahi_himawari8_obs_2019042306_s.nc4 1057:ufo_data_validate_aircraft_artificial_bias.nc4 1058:ufo_data_validate_aircraft_artificial_bias_2.nc4 1059:ufo_data_validate_aircraft_obs_2018041500_m.nc4 1060:ufo_data_validate_aircraft_obs_2018041500_s.nc4 1061:ufo_data_validate_airnow-v2a-2020081306-sub.nc 1062:ufo_data_validate_airs_aqua_20210701T1200Z_obs_obfn_setsurface.nc4 1063:ufo_data_validate_airs_aqua_obs_2018041500_m.nc4 1064:ufo_data_validate_airs_aqua_obs_2018041500_m_unittest.nc4 1065:ufo_data_validate_amsr2_gcom-w1_obs_2020111500.nc4 1066:ufo_data_validate_amsr2_gcom-w1_obs_2020120100_m.nc4 1067:ufo_data_validate_amsr2_obs_20191230T0000Z_100subset.nc4 1068:ufo_data_validate_amsua_n19_hofxnm_2018041500_m_rttovcpp.nc4 1069:ufo_data_validate_amsua_n19_obs_2018041500_m.nc4 1070:ufo_data_validate_amsua_n19_obs_2018041500_m_miss_val.nc4 1071:ufo_data_validate_amsua_n19_obs_2018041500_m_qc.nc4 1072:ufo_data_validate_amsua_n19_obs_2018041500_m_with_diag_flags.nc4 1073:ufo_data_validate_aod_obs_2018041500_m.nc4 1074:ufo_data_validate_aod_obs_2018041500_m_predictors.nc4 1076:ufo_data_validate_atms_n20_obs_20191230T0000_rttov.nc4 1077:ufo_data_validate_atms_n20_obs_20191230T0000_rttov_bad_data.nc4 1078:ufo_data_validate_atms_n20_obs_20191230T0000_rttov_biaspred_redo_scan.nc4 1079:ufo_data_validate_atms_n20_obs_20191230T0000_setsurface_default.nc4 1081:ufo_data_validate_atms_n20_obs_20210701T1200Z_ukv.nc4 1083:ufo_data_validate_atms_npp_obs_2018041500_m_qc.nc4 1084:ufo_data_validate_atms_obs_20191230T0000_rttov_predictors.nc4 1086:ufo_data_validate_atms_obs_20200401T0000Z_10locs.nc4 1087:ufo_data_validate_atovs_metopb_obs_2021011512_rttov_scatt.nc4 1088:ufo_data_validate_atovs_metopb_obs_2021011512_rttov_scatt_add.nc4 1090:ufo_data_validate_atovs_obs_2021011512_multiplatform.nc4 1091:ufo_data_validate_background_errors_for_altimeter_test.nc4 1092:ufo_data_validate_background_errors_for_bayesianbgcheck_test.nc4 1093:ufo_data_validate_bayesianbgcheck_filter_testdata.nc4 1094:ufo_data_validate_converr_vadwind_obs_2020120112_s.nc4 1095:ufo_data_validate_coolskin_fake_obs_2018041500.nc1096:ufo_data_validate_crisfsr_n20_obs_2020121500_m.nc4 1097:ufo_data_validate_cris-fsr_npp_obs_2018041500_m.nc4 1098:ufo_data_validate_cris-fsr_npp_obs_2018041500_m_qc.nc4 1099:ufo_data_validate_cris-fsr_npp_obs_2018041500_m_unittest.nc4 1102:ufo_data_validate_drawvaluefromfile_advanced.nc 1103:ufo_data_validate_drawvaluefromfile_advanced4.nc 1104:ufo_data_validate_drawvaluefromfile_advanced5.nc 1105:ufo_data_validate_drawvaluefromfile_extrap.nc 1106:ufo_data_validate_drawvaluefromfile_simple.nc 1107:ufo_data_validate_filters_testdata.nc4 1108:ufo_data_validate_function_copybackflags_testdata.nc4 1109:ufo_data_validate_function_datetimeoffset.nc4 1110:ufo_data_validate_function_profilelevelcount.nc4 1111:ufo_data_validate_function_select_testdata.nc4 1112:ufo_data_validate_geos.mhs_metop-b_obs.2020121500_m.nc4 1113:ufo_data_validate_geos_amsua_n19_obs_2020121500.nc4 1114:ufo_data_validate_geos_aod_obs_2018041500_m.nc4 1115:ufo_data_validate_geos_atms_n20_obs_2020121500.nc4 1116:ufo_data_validate_gmi_gpm_obs_2018041500_m.nc4 1117:ufo_data_validate_gmi_gpm_obs_2020111500.nc4 1118:ufo_data_validate_gmi_gpm_obs_2020120100_m.nc4 1119:ufo_data_validate_gmi_gpm_obs_2020121500_m.nc4 1121:ufo_data_validate_gnssro_bend_obs_2022061500_m.nc4 1122:ufo_data_validate_gnssro_obs_2018041500_1obs_bending_angle.nc4 1123:ufo_data_validate_gnssro_obs_2018041500_3prof.nc4 1124:ufo_data_validate_gnssro_obs_2018041500_3prof_avtemp.nc4 1125:ufo_data_validate_gnssro_obs_2018041500_m.nc4 1126:ufo_data_validate_gnssro_obs_2018041500_s.nc4 1127:ufo_data_validate_gnssro_obs_2019050700_1obs.nc4 1128:ufo_data_validate_gnssro_obs_2019123006_refractivity.nc4 1129:ufo_data_validate_gnssro_obs_2019123006_refractivity_nopseudo.nc4 1130:ufo_data_validate_gnssro_obs_2020050106_1dvar.nc4 1131:ufo_data_validate_gnssro_obs_2020050106_nopseudo.nc4 1132:ufo_data_validate_gnssro_obs_20210701T1200Z_profile.nc4 1133:ufo_data_validate_gnssro_obs_6prof_2022090100.nc4 1134:ufo_data_validate_gome_metop-a_obs_2019101700_m.nc4 1135:ufo_data_validate_grosserrorwholereport_filter_testdata.nc4 1137:ufo_data_validate_gsisfc_tsen_obs_2018041500_m.nc4 1138:ufo_data_validate_gsisfc_uv_obs_2018041500_m.nc4 1139:ufo_data_validate_hirs4_metop-a_obs_2018041500_m.nc4 1140:ufo_data_validate_iasi_metop-a_obs_2018041500_m.nc4 1141:ufo_data_validate_iasi_metop-a_obs_2018041500_m_qc.nc4 1142:ufo_data_validate_iasi_metop-a_obs_2018041500_m_unittest.nc4 1143:ufo_data_validate_iasi_metop-b_202011012_missingVals.nc4 1144:ufo_data_validate_iasi_metopb_obs_2021011500.nc4 1145:ufo_data_validate_icec-2018-04-15.nc1146:ufo_data_validate_aircraft_obs_2020121500_m.nc 1147:ufo_data_validate_aircraft_obs_2021121200_m.nc4 1149:ufo_data_validate_ompsnp_npp_obs_2020121500.nc 1150:ufo_data_validate_pibal_obs_2021121200_m.nc4 1151:ufo_data_validate_rass_tv_obs_2020121500.nc 1152:ufo_data_validate_satwind_obs_2020121500_m.nc 1153:ufo_data_validate_satwind_obs_2021121200_m.nc4 1154:ufo_data_validate_scatwind_obs_2020121500_m.nc 1155:ufo_data_validate_scatwind_obs_2021121200_m.nc4 1156:ufo_data_validate_sfc_obs_2020121500_m.nc 1157:ufo_data_validate_sfc_obs_2021121200_m.nc4 1158:ufo_data_validate_sfcship_obs_2020121500_m.nc 1159:ufo_data_validate_sfcship_obs_2021121200_m.nc4 1160:ufo_data_validate_sondes_obs_2020121500_m.nc 1161:ufo_data_validate_sondes_obs_2021121200_m.nc4 1162:ufo_data_validate_vadwind_obs_2020121500.nc 1163:ufo_data_validate_abi_g16_obs_2021051700_m.nc4 1164:ufo_data_validate_airs_aqua_obs_2020110112_m.nc4 1165:ufo_data_validate_amsua_aqua_obs_2020110112_m.nc4 1166:ufo_data_validate_amsua_metop-a_obs_2020110112_m.nc4 1167:ufo_data_validate_amsua_metop-b_obs_2020110112_m.nc4 1168:ufo_data_validate_amsua_metop-c_obs_2020110112_m.nc4 1169:ufo_data_validate_amsua_n15_obs_2020110112_m.nc4 1170:ufo_data_validate_amsua_n18_obs_2020110112_m.nc4 1171:ufo_data_validate_amsua_n19_obs_2020110112_m.nc4 1172:ufo_data_validate_atms_n20_obs_2020110112_m.nc4 1173:ufo_data_validate_atms_npp_obs_2020110112_m.nc4 1174:ufo_data_validate_avhrr_metop-a_obs_2020110112_m.nc4 1175:ufo_data_validate_avhrr_n18_obs_2020110112_m.nc4 1176:ufo_data_validate_cpr_cloudsat_obs_2009113003.nc4 1177:ufo_data_validate_cris-fsr_n20_obs_2020110112_m.nc4 1178:ufo_data_validate_cris-fsr_npp_obs_2020110112_m.nc4 1179:ufo_data_validate_iasi_metop-a_obs_2020110112_m.nc4 1180:ufo_data_validate_iasi_metop-b_obs_2020110112_m.nc4 1181:ufo_data_validate_mhs_metop-b_obs_2020110112_m.nc4 1182:ufo_data_validate_mhs_metop-c_obs_2020110112_m.nc4 1183:ufo_data_validate_mhs_n19_obs_2020110112_m.nc4 1184:ufo_data_validate_seviri_m11_obs_2020110112_m.nc4 1185:ufo_data_validate_ssmis_f17_obs_2020110112_m.nc4 1186:ufo_data_validate_jopa_gmihigh_20210701T1200Z_out_m.nc4 1187:ufo_data_validate_linear_combination_multichannel_unittest.nc4 1188:ufo_data_validate_met_office_bayesian_background_qc_flags.nc 1189:ufo_data_validate_met_office_bayesian_background_qc_flags_missing_variables.nc 1190:ufo_data_validate_met_office_buddy_check.nc4 1191:ufo_data_validate_met_office_buddy_check_multi_level.nc 1192:ufo_data_validate_met_office_buddy_check_multi_level_diag.nc 1193:ufo_data_validate_met_office_buddy_check_multi_level_diag_extended.nc 1196:ufo_data_validate_met_office_buddy_check_multi_level_nonconsec.nc 1197:ufo_data_validate_met_office_buddy_check_oceanprofile.nc4 1198:ufo_data_validate_met_office_buddy_check_single_level.nc 1199:ufo_data_validate_met_office_buddy_check_single_level_diag.nc 1200:ufo_data_validate_met_office_composite_operator_sonde_obs.nc4 1201:ufo_data_validate_met_office_conventional_profile_processing.nc4 1202:ufo_data_validate_met_office_conventional_profile_processing_average_pressure_obs_extended.nc4 1203:ufo_data_validate_met_office_conventional_profile_processing_average_relativehumidity_obs.nc4 1204:ufo_data_validate_met_office_conventional_profile_processing_average_relativehumidity_obs_extended.nc4 1206:ufo_data_validate_met_office_conventional_profile_processing_average_temperature_obs.nc4 1207:ufo_data_validate_met_office_conventional_profile_processing_average_temperature_obs_extended.nc4 1208:ufo_data_validate_met_office_conventional_profile_processing_average_windspeed_obs.nc4 1209:ufo_data_validate_met_office_conventional_profile_processing_average_windspeed_obs_extended.nc4 1210:ufo_data_validate_met_office_conventional_profile_processing_bkgqc_modobs.nc4 1211:ufo_data_validate_met_office_conventional_profile_processing_bkgqc_repobs.nc4 1212:ufo_data_validate_met_office_conventional_profile_processing_oneprofile.nc4 1213:ufo_data_validate_met_office_conventional_profile_processing_oneprofile_wrong.nc4 1214:ufo_data_validate_met_office_conventional_profile_processing_pressure_obs.nc4 1216:ufo_data_validate_met_office_conventional_profile_processing_rh.nc4 1217:ufo_data_validate_met_office_conventional_profile_processing_rh_wrong.nc4 1218:ufo_data_validate_met_office_conventional_profile_processing_sondeflags.nc4 1219:ufo_data_validate_met_office_conventional_profile_processing_uinterp.nc4 1220:ufo_data_validate_met_office_conventional_profile_processing_unittests.nc4 1221:ufo_data_validate_met_office_conventional_profile_processing_unittests_vertaverage.nc4 1222:ufo_data_validate_met_office_conventional_profile_processing_unittests_vertaverage_ascending.nc4 1223:ufo_data_validate_met_office_conventional_profile_processing_unittests_vertinterp_obs.nc4 1224:ufo_data_validate_met_office_conventional_profile_processing_winproflags.nc4 1225:ufo_data_validate_met_office_conversion_height2pressure.nc4 1226:ufo_data_validate_met_office_conversion_pressure2height.nc4 1227:ufo_data_validate_met_office_conversion_pressure2height_levels.nc4 1228:ufo_data_validate_met_office_conversion_td2Rh_missing_rh.nc4 1229:ufo_data_validate_met_office_conversion_td2Rh_surface.nc4 1230:ufo_data_validate_met_office_conversion_td2Rh_upperair.nc4 1231:ufo_data_validate_met_office_duplicate_check.nc4 1237:ufo_data_validate_met_office_poisson_disk_thinning.nc4 1238:ufo_data_validate_met_office_poisson_disk_thinning_sort.nc4 1239:ufo_data_validate_met_office_pressure_consistency_check.nc4 1240:ufo_data_validate_met_office_profile_horizontal_drift.nc4 1241:ufo_data_validate_met_office_profile_horizontal_drift_keep_in_window.nc4 1242:ufo_data_validate_met_office_rh_corr_gv.nc4 1243:ufo_data_validate_met_office_rh_corr_obs.nc4 1244:ufo_data_validate_met_office_surfacecloud_cloud_base_height_check.nc4 1245:ufo_data_validate_met_office_surfacecloud_cloud_column_check.nc4 1246:ufo_data_validate_met_office_temporal_thinning_sonde.nc4 1247:ufo_data_validate_met_office_temporal_thinning_surface.nc41248:ufo_data_validate_met_office_thinning.nc4 1249:ufo_data_validate_mhs_metop-b_obs_2018041500_m_interpolate_date_from_file_predictors.nc4 1250:ufo_data_validate_mhs_n19_obs_2018041500_m.nc4 1251:ufo_data_validate_mhs_n19_obs_2018041500_m_qc.nc4 1252:ufo_data_validate_mixRatio2RH_conversion_aircraft.nc4 1253:ufo_data_validate_mixRatio2RH_conversion_aircraft_nosupersat.nc4 1254:ufo_data_validate_mopitt_co_2020090318_m.nc4 1255:ufo_data_validate_multichannel_variable_assignment_testdata.nc 1256:ufo_data_validate_nnr_aod_3ch_obs_2018041500_m.nc4 1257:ufo_data_validate_obs_atms_20200401T0000Z_satrad_thinning.nc4 1258:ufo_data_validate_obs_atovs_lwpguess_20210701T1200Z.nc4 1259:ufo_data_validate_obs_atovs_transmittance_20210701T1200Z.nc4 1260:ufo_data_validate_obs_radar_mrms_202205122200.nc 1261:ufo_data_validate_obs_ssmis_onedvar_20210701T1200Z.nc4 1262:ufo_data_validate_obserror_corr_3var.nc4 1263:ufo_data_validate_obserror_corr_test.nc4 1264:ufo_data_validate_obserror_lower_upper_bounds.nc 1265:ufo_data_validate_obserror_misspelled_variance.nc 1266:ufo_data_validate_obserror_multiple_variances.nc 1267:ufo_data_validate_obsfunction_exponential_testdata.nc4 1269:ufo_data_validate_ocean_vertical_stability_testdata.nc4 1270:ufo_data_validate_oceanprofile_averageobs_testdata.nc4 1271:ufo_data_validate_oceanprofile_duplicatecheck.nc4 1272:ufo_data_validate_oceanprofile_fake_obsdata.nc4 1273:ufo_data_validate_oceanprofile_theta_pressure_testdata.nc4 1274:ufo_data_validate_omi_aura_obs_2019101700_m.nc4 1275:ufo_data_validate_ompslp_npp_obs_2019101700_m.nc4 1276:ufo_data_validate_ompsnp_npp_obs_2019101700_m.nc4 1277:ufo_data_validate_ompsnp_npp_obs_2019101700_m_colret.nc4 1278:ufo_data_validate_ompsnp_npp_obs_2020051712_m.nc4 1279:ufo_data_validate_ompsnp_npp_obs_2020051712_qc.nc4 1280:ufo_data_validate_ompstc8_npp_obs_2019101700_m.nc4 1282:ufo_data_validate_poisson_disk_thinning_3x3x3x3_regular_grid.nc4 1283:ufo_data_validate_poisson_disk_thinning_median_selection_3x3x3x3_regular_grid.nc4 1284:ufo_data_validate_productOperator_testData.nc4 1285:ufo_data_validate_profile_2018-04-15.nc 1286:ufo_data_validate_profile_filter_testdata.nc4 1287:ufo_data_validate_radar_dbz_obs_2019052222.nc4 1288:ufo_data_validate_radar_rw_obs_2020101300_m.nc4 1289:ufo_data_validate_sataltimeter_sla_testdata.nc4 1291:ufo_data_validate_satwind_obs_1d_2020100106_noinv.nc4 1292:ufo_data_validate_satwind_obs_1d_2020100106_noinv_qiODB.nc4 1293:ufo_data_validate_satwind_obs_1d_2020100106_yesinv.nc4 1294:ufo_data_validate_satwind_obs_1d_small_2020100106_noinv.nc4 1295:ufo_data_validate_satwind_obs_2018041500_m.nc4 1296:ufo_data_validate_satwind_obs_2018041500_s.nc4 1297:ufo_data_validate_satwind_obs_errnorm.nc4 1298:ufo_data_validate_sbuv2_n19_obs_2018041500_m.nc4 1299:ufo_data_validate_sbuv2_n19_obs_2020051712_m.nc4 1300:ufo_data_validate_scatwind_components_2021080100_small.nc4 1301:ufo_data_validate_scatwind_obs_1d_2020100106.nc4 1302:ufo_data_validate_scatwind_obs_1d_small_2020100106.nc4 1303:ufo_data_validate_scatwind_obs_2d_20220602T1200Z.nc4 1304:ufo_data_validate_seviri_m08_obs_2018041500_m.nc4 1305:ufo_data_validate_sfc_obs_2018041500_m.nc4 1306:ufo_data_validate_sfc_obs_2018041500_metars_small.nc 1307:ufo_data_validate_sfc_obs_2018041500_metars_small2.nc 1308:ufo_data_validate_sfc_obs_2018041500_new.nc4 1309:ufo_data_validate_sfcship_obs_2018041500_m.nc4 1310:ufo_data_validate_sfcship_synthetic_airtemp_m.nc4 1311:ufo_data_validate_shiptrack_recordssingleobs_testdata.nc4 1312:ufo_data_validate_smap_obs_2018041500_m.nc4 1313:ufo_data_validate_smap_smc_obs_20191215.nc 1314:ufo_data_validate_sndrd1_g15_obs_2018041500_m.nc4 1315:ufo_data_validate_sndrd2_g15_obs_2018041500_m.nc4 1316:ufo_data_validate_sndrd3_g15_obs_2018041500_m.nc4 1317:ufo_data_validate_sndrd4_g15_obs_2018041500_m.nc4 1318:ufo_data_validate_solar_zenith.nc4 1319:ufo_data_validate_sondes_fake_20201101.nc4 1320:ufo_data_validate_sondes_obs_2018041500_m.nc4 1321:ufo_data_validate_sondes_obs_2018041500_m_conventions.nc4 1322:ufo_data_validate_sondes_obs_2018041500_s.nc4 1323:ufo_data_validate_sondes_obs_2018041500_s_interpolate_data_from_file_predictors.nc4 1324:ufo_data_validate_sondes_obs_2018041500_s_missingp.nc4 1325:ufo_data_validate_sondes_obs_2018041500_s_namemap.nc4 1326:ufo_data_validate_sondes_obs_2018041500_vs.nc4 1327:ufo_data_validate_sondes_q_obs_2020121500_UKMO.nc4 1328:ufo_data_validate_sondes_q_obs_2020121500_singular.nc4 1329:ufo_data_validate_sondes_q_obs_2020121500_vector.nc4 1330:ufo_data_validate_sondes_tv_obs_2018041500_m.nc4 1331:ufo_data_validate_spikestep_testdata.nc4 1332:ufo_data_validate_ssmis_f17_20210521T1200Z_obfn_orbit_angle_ref.nc4 1333:ufo_data_validate_ssmis_f17_20210521T1200Z_obfn_ref.nc4 1334:ufo_data_validate_ssmis_f18_obs_2018041500_m.nc4 1335:ufo_data_validate_ssmis_obs_20191230T0000Z_orbital_angle.nc4 1336:ufo_data_validate_sst_obs-2018-04-15.nc4 1338:ufo_data_validate_surface_marine_obs_20210521T1200Z.nc4 1341:ufo_data_validate_synthetic-adt-2018041500.nc 1343:ufo_data_validate_tempo_no2_stratosphere.nc 1344:ufo_data_validate_tempo_no2_total.nc 1345:ufo_data_validate_tempo_no2_troposphere.nc 1346:ufo_data_validate_thinning_records.nc4 1348:ufo_data_validate_tropomi_co_total_2021081518_m.nc4 1349:ufo_data_validate_tropomi_no2_total_2020090318_m.nc4 1350:ufo_data_validate_tropomi_no2_tropo_2020090318_m.nc4 1351:ufo_data_validate_variable_assignment_testdata.nc 1352:ufo_data_validate_variable_assignment_testdata_channels.nc 1353:ufo_data_validate_viirs_jpss1_oc_l2_2018-04-15.nc 1354:ufo_data_validate_wind_unit_transforms_2018041500.nc4 1358:ufo_data_validate_windprof_obs_2018041500_m.nc4

[PatNichols]

There are 286 failures out of 316 validation tests...