Use Python API to convert ADPUPA prepbufr pressure data to IODA and check if this can be used with UFO seamlessly

[PraveenKumar-NOAA]

Configuration

• Test Date is 2021080100
• Model Background: FV-3 6-hour forecast on the cubic-sphere grid
• BUFR Converter:
  • convert timeOffset/timeCycleProfileLevel to dateTime (in units of seconds since 1970-01-01T00:00:00Z)
  • convert longitude from [0,360] to [-180,180]
  • Add conversions of: latitude, longitude, prepbufrDataLevelCategory, pressure/stationPressure

Test using fv3jedi_hofx_nomodel.x with the IODA files converted from BUFR converter

• Convert BUFR to IODA format using Python API
• Run UFO HofX

Check List

Investigate diag output from UFO

• [x] ADPUPA prepbufr version of Python API
• [ ] Compare Python version of IODA with bufr2ioda IODA
• [x] ADPUPA HofX

[PraveenKumar-NOAA]

Finished Python API version for ADPUPA prepbufr and ran bufr -> ioda. The stationPressure (POB) values looked reasonable in prepbufr and IODA files.

But when I ran hofx using this IODA file and plotted POB vs hofx, the plot is not as expected:

Preliminary analysis ObsValue/stationPressure min = 290.0 ObsValue/stationPressure max = 103100.0 hofx/stationPressure min = 58952.758 hofx/stationPressure max = 105884.055

The values below 58000 Pa are missing in hofx.

I used the following YAML for my hofx: Orion: /work2/noaa/da/pkumar/AdpupaPythonConv/YAML/HofXnbc/2021080100/gfs_hofx_nomodel_adpupa_wps_2021080100.yaml

_observations: get values: variable change: variable change name: Model2GeoVaLs hydrometeor effective radii method: gsi mask over: land observers:

• obs space: name: SurfaceComposite obsdatain: engine: type: H5File obsfile: /work2/noaa/da/pkumar/IODA_CONVR_Python/testoutput/ADPUPA_prepbufr_wps.nc obsdataout: engine: type: H5File obsfile: diags/adpupa_wps_hofx_nbc_2021080100.nc4 simulated variables: [windEastward, windNorthward, airTemperature, virtualTemperature, specificHumidity, stationPressure] obs operator: name: Composite components:
  • name: VertInterp variables:
    • name: windEastward
    • name: windNorthward
    • name: airTemperature
    • name: virtualTemperature
    • name: specificHumidity
  • name: SfcPCorrected da_psfc_scheme: GSI geovar_sfc_geomz: surface_geopotential_height geovar_geomz: geopotential_height variables:
    • name: stationPressure_

@emilyhcliu @CoryMartin-NOAA any suggestions?

[PraveenKumar-NOAA]

@emilyhcliu after extracting pressure data for prepbufrDataLevelCategory (CAT=1), I ran bufr -> ioda -> hofx and got the following results:

[PraveenKumar-NOAA]

Results from running GDASApp for ~/parm/atm/obs/testing/sondes_ps.yaml are shown in the plot, which are very similar to the one shown above:

[PraveenKumar-NOAA]

@emilyhcliu bufr -> ioda -> hofx plumbing work is completed for ADPUPA prepbufr and the hofx/GSIhofx/ObsVlaue stationPressure (for CAT=1) plots turned out very well. Let me know what you think?

[PraveenKumar-NOAA]

@emilyhcliu stationPressure plot: