[End-to-End Test Code Sprint] BUFR to IODA converter for ADPUPA bufr dump

[PraveenKumar-NOAA]

Configuration

• Test Date is 2021080100
• BUFR Converter:
  • Convert time to dateTime (in units of seconds since 1970-01-01T00:00:00Z)
  • Add conversions of: latitude, longitude, stationIdentification, stationElevation, windEastward, windNorthward, airTemperature, dewPointTemperature, and pressure
• Convert BUFR to IODA format using Python API
• Create a JSON file for the converter
• Run and update run_bufr2ioda.py for the converter
• Run UFO HofX

Check List

Investigate diag output from UFO

• [x] bufr2ioda_adpupa.json
• [x] ADPUPA bufr version of Python API
• [x] dateTime, receiptTime, launchTime
• [ ] driftTime, driftLatitude, driftLongitude
• [ ] ADPUPA HofX
• [ ] GSI HofX

The following ADPUPA BUFR subsets will be included into the converter:

| NC002001 | A63218 | MSG TYPE 002-001 RAWINSONDE - FIXED LAND | | NC002002 | A63219 | MSG TYPE 002-002 RAWINSONDE - MOBIL LAND | | NC002003 | A63220 | MSG TYPE 002-003 RAWINSONDE - SHIP | | NC002004 | A63221 | MSG TYPE 002-004 DROPWINSONDE | | NC002005 | A63222 | MSG TYPE 002-005 PIBAL |

[PraveenKumar-NOAA]

A first version of the API is finished using the original LAT/LON. The end-to-end tests were run and scatter plots were created for the following observations:

airTemperature:

windEastward:

windNorthward:

[PraveenKumar-NOAA]

JEDI h(x) vs obsValues plots created after fixing the dateTime variable issues:

airTemperature:

windEastward:

windNorthward:

[PraveenKumar-NOAA]

Comparison of the data files generated using the prepBUFR and BUFR Python API:

prepBUFR: Total Counts or locations - 270,600 (1353, 200) BUFR: Total Counts or locations - 188,190 (738, 255)

Pressure Comparison:

prepBUFR Location - 270600 Missing values - 190565 Total obs - (270600 - 190565) = 80,035

BUFR Location - 188190 Missing values - 123236 Total obs - (188190 - 123236) = 64,954

[PraveenKumar-NOAA]

Wind Comparison:

prepBUFR Location - 270600 Missing values - 228986 Total obs - (270600 - 228986) = 41,614

BUFR Location - 188190 Missing values - 135259 Total obs - (188190 - 135259) = 52931

[PraveenKumar-NOAA]

windNorthward:

[PraveenKumar-NOAA]

Temperature Comparison:

prepBUFR Location - 270600 Missing values - 255384 Total obs - (270600 - 255384) = 15,216

BUFR Location - 188190 Missing values - 142596 Total obs - (188190 - 142596) = 45,594

[PraveenKumar-NOAA]

@emilyhcliu I created plots for the pressure, wind, and temperature observations using the ioda files generated using the adpupa prepbufr and bufr python api. Please look at these plots and let me know your comments/suggestions.

[PraveenKumar-NOAA]

Validation for the Python API converter: following plots were created using observation from the input BUFR DUMP and output IODA files:

BUFR/pressure:

IODA/pressure:

[PraveenKumar-NOAA]

BUFR/airTemperature:

IODA/airTemperature: