Observer End-to-End Test for OMPS NP

[emilyhcliu]

End-to-End Tests for OMPS NP Processing

• [x] Create BUFR converter - python script

  • [x] Test BUFR converted IODA obs input to H(x)
  • [x] Test BUFR converted IODA obs input to H(x) + initial error assignment + read routine QC
  • [x] Test BUFR converted IODA obs input to H(x) + initial error assignment + read routine QC + setup routine QC

  Issues found in the existing data filtering yaml (omi_aura.yaml) are documented here:

  • Need to exclude total ozone data from the profile data (add a filter to remove total ozone data)
  • Gross check needs to be updated - obs and gross errors changed for top 5 layers
  • Top five layers are assimilated
  • Quality control variable types do not comply with IODA convention --- they need to be integers
  • Quality control variable names do not comply with IODA convention --- should be camel case

Updates made and tested

• Added filter to remove total ozone data
• Updated observation error assignment
• Updated gross check
• Removed the filter, which excludes the top 5 layers
• The quality control flags (toq and poq) are integers. Modified the filters accordingly in the YAML
• The quality control flags names do not comply IODA convention (should be camel case). SBUVTOQ (toq) - total ozone quality ---> totalOzoneQuality SBUVPOQ(poa) - profile ozone quality ---> profileOzoneQuality

  ---

QC Procedures: (Data thinning not applied)

read routine QC

• Remove total ozone data from profile data
• Observation value sanity check
• Total Ozone quality check
• Profile Ozone quality check

setup routine QC

• Background departure gross check |O-F| > min(10*obserr, 300)

[emilyhcliu]

HofX (with total column removed) Comparison: UFO vs. GSI for each pressure layer

Pressure (hPa) from High to Low (1013, 640, 400, 250, 160, 101, 64, 40, 25, 16, 10, 6, 5, 2.5, 1.6, 1, 0.5, 0,4, 0.25, 0.16, 0.1] UFO O-F	GSI O-F
		!
		!

[emilyhcliu]

HofX (after QC) Comparison: UFO vs. GSI for each pressure layer

Pressure (hPa) from High to Low (1013, 640, 600, 250, 160, 101, 64, 40, 25, 16, 10, 6, 5, 2.5, 1.6, 1, 0.5, 0,4, 0.25, 0.16, 0.1]

UFO O-F vs. GSI O-F @ 100 hPa

Plots for other layers are here