Adding satwinds from the Visible Infrared Imaging Radiometer Suite (VIIRS) from SNPP/NOAA-20 to GDASApp end-to-end testing
new files include:
parm/atm/obs/config/satwind_viirs_npp.yaml.j2: QC filter YAML for VIIRS SNPP satwinds (jinja2 standard)
parm/atm/obs/config/satwind_viirs_n20.yaml.j2: QC filter YAML for VIIRS NOAA-20 satwinds (jinja2 standard)
parm/ioda/bufr2ioda/bufr2ioda_satwind_amv_viirs.json: JSON containing data format, sensor, and satellite information for VIIRS SNPP/NOAA-20 satwinds
ush/ioda/bufr2ioda/bufr2ioda_satwind_amv_viirs.py: bufr2ioda code for extracting VIIRS SNPP/NOAA-20 satwinds from BUFR
End-to-End Test Results
VIIRS satwinds consist of (LW)IR (type=260) from SNPP and NOAA-20 satellites that are tanked and dumped into BUFR subset NC005091. No thinning is applied to these tests in either GSI or JEDI by regular convention.
SNPP LW(IR) Satwinds (type=260, subtype=224)
There are 39240 SNPP VIIRS LW(IR) satwinds in the UFO test dataset and 39236 in the GSI. The outstanding 4 satwinds that appear in the UFO diag file but not in the GSI diag file are all at pressures less than 125 hPa and are rejected by a pressure-check filter. There are no VIIRS observations at pressures less than 125 hPa in the GSI diag file. There are 27529 satwinds assimilated in JEDI and 27560 in GSI, a difference of roughly 0.1%.
Accepted observations are distributed similarly between GSI and JEDI:
The windEastward and windNorthward values, their HofX values, and the OmB look good comparing GSI and JEDI:
Overall error comparisons between JEDI and GSI look good - there are a few outstanding differences where GSI assigns a higher error to an observation than JEDI, but these are infrequent and are likely due to differences in duplicate error inflation since GSI is processing all AMVs on a single processor and can identify duplicates across types while JEDI processes types on separate processors and the cross-type duplicates are invisible.
plan map distribution:
vertical profile:
NOAA-20 LW(IR) Satwinds (type=260, subtype=225)
There are 44849 NOAA-20 VIIRS LW(IR) satwinds in the UFO test dataset and 44847 in the GSI. The outstanding 2 satwinds that appear in the UFO diag file but not in the GSI diag file are all at pressures less than 125 hPa and are rejected by a pressure-check filter. There are no VIIRS observations at pressures less than 125 hPa in the GSI diag file. There are 31839 satwinds assimilated in JEDI and 31863 in GSI, a difference of roughly 0.07%.
Accepted observations are distributed similarly between GSI and JEDI:
The windEastward and windNorthward values, their HofX values, and the OmB look good comparing GSI and JEDI:
Overall error comparisons between JEDI and GSI look good - there are a few outstanding differences where GSI assigns a higher error to an observation than JEDI, but these are infrequent and are likely due to differences in duplicate error inflation since GSI is processing all AMVs on a single processor and can identify duplicates across types while JEDI processes types on separate processors and the cross-type duplicates are invisible.
Adding satwinds from the Visible Infrared Imaging Radiometer Suite (VIIRS) from SNPP/NOAA-20 to GDASApp end-to-end testing
new files include: parm/atm/obs/config/satwind_viirs_npp.yaml.j2: QC filter YAML for VIIRS SNPP satwinds (jinja2 standard) parm/atm/obs/config/satwind_viirs_n20.yaml.j2: QC filter YAML for VIIRS NOAA-20 satwinds (jinja2 standard) parm/ioda/bufr2ioda/bufr2ioda_satwind_amv_viirs.json: JSON containing data format, sensor, and satellite information for VIIRS SNPP/NOAA-20 satwinds ush/ioda/bufr2ioda/bufr2ioda_satwind_amv_viirs.py: bufr2ioda code for extracting VIIRS SNPP/NOAA-20 satwinds from BUFR
End-to-End Test Results
VIIRS satwinds consist of (LW)IR (type=260) from SNPP and NOAA-20 satellites that are tanked and dumped into BUFR subset NC005091. No thinning is applied to these tests in either GSI or JEDI by regular convention.
SNPP LW(IR) Satwinds (type=260, subtype=224)
There are 39240 SNPP VIIRS LW(IR) satwinds in the UFO test dataset and 39236 in the GSI. The outstanding 4 satwinds that appear in the UFO diag file but not in the GSI diag file are all at pressures less than 125 hPa and are rejected by a pressure-check filter. There are no VIIRS observations at pressures less than 125 hPa in the GSI diag file. There are 27529 satwinds assimilated in JEDI and 27560 in GSI, a difference of roughly 0.1%.
Accepted observations are distributed similarly between GSI and JEDI:![image](https://github.com/NOAA-EMC/GDASApp/assets/98188219/f53822fb-1e42-48a4-841c-26db8a61bf64)
The
![image](https://github.com/NOAA-EMC/GDASApp/assets/98188219/ca156809-fa1c-4bdc-be3c-a0ae4b5423fd)
windEastward
andwindNorthward
values, their HofX values, and the OmB look good comparing GSI and JEDI:Overall error comparisons between JEDI and GSI look good - there are a few outstanding differences where GSI assigns a higher error to an observation than JEDI, but these are infrequent and are likely due to differences in duplicate error inflation since GSI is processing all AMVs on a single processor and can identify duplicates across types while JEDI processes types on separate processors and the cross-type duplicates are invisible.
plan map distribution:
vertical profile:
![image](https://github.com/NOAA-EMC/GDASApp/assets/98188219/03c0b784-8973-4ec6-9fca-403b0d007a57)
NOAA-20 LW(IR) Satwinds (type=260, subtype=225) There are 44849 NOAA-20 VIIRS LW(IR) satwinds in the UFO test dataset and 44847 in the GSI. The outstanding 2 satwinds that appear in the UFO diag file but not in the GSI diag file are all at pressures less than 125 hPa and are rejected by a pressure-check filter. There are no VIIRS observations at pressures less than 125 hPa in the GSI diag file. There are 31839 satwinds assimilated in JEDI and 31863 in GSI, a difference of roughly 0.07%.
Accepted observations are distributed similarly between GSI and JEDI:![image](https://github.com/NOAA-EMC/GDASApp/assets/98188219/e3b72e9d-7e8d-4750-bb00-3b38144c70f2)
The
![image](https://github.com/NOAA-EMC/GDASApp/assets/98188219/22830692-498b-4bea-b1a7-a8764471d385)
windEastward
andwindNorthward
values, their HofX values, and the OmB look good comparing GSI and JEDI:Overall error comparisons between JEDI and GSI look good - there are a few outstanding differences where GSI assigns a higher error to an observation than JEDI, but these are infrequent and are likely due to differences in duplicate error inflation since GSI is processing all AMVs on a single processor and can identify duplicates across types while JEDI processes types on separate processors and the cross-type duplicates are invisible.
plan map distribution:
vertical profile:
![image](https://github.com/NOAA-EMC/GDASApp/assets/98188219/3ed72acf-93a3-409d-9d6d-cc615bf921f8)