NOAA-EMC / GDASApp

Global Data Assimilation System Application
GNU Lesser General Public License v2.1
15 stars 31 forks source link

[End-to-End Test Code Sprint] Update SFCSHP prepbufr converter and related YAMLs #729

Open nicholasesposito opened 11 months ago

nicholasesposito commented 11 months ago
  1. Minor update for SFCSHP prepbufr converter - edited/added some height variables.
    • Edited/added height variables
    • Added ObsErrors for the simulated variables except stationEleveation (there is no ObsError mnemonic for it)
  2. Update SFCSHP YAML
    • The GMAO yaml is not yet checked yet
    • The first run had the original filters kept in.
    • The second run removed the filtering but added the linear obs operators from the GMAO yaml. The stationPressure parts were removed from the linear obs operators. Only u, v, q, Tsen and Tvir were simulated.

Results of the second run: All have 0 rejected except vars which were not simulated vars in the yaml (SST, elv, P)

nicholasesposito commented 11 months ago

For the first run, I generated plots of:

  1. plot hofx0 where EffectiveQC=0 for each var
  2. plot obsvalue-hofx0 (o-f) with QC (EffectiveQC=0)
  3. plot obsvalue-hofx0 (o-f) withoutqc The plots are below:

1 sfcshp_stationPressure_hofxWhereEffqcIs0 sfcshp_specificHumidity_hofxWhereEffqcIs0 sfcshp_airTemperature_hofxWhereEffqcIs0

2. sfcshp_airTemperature_omfWhereEffqcIs0 sfcshp_specificHumidity_omfWhereEffqcIs0 sfcshp_stationPressure_omfWhereEffqcIs0

3. sfcshp_airTemperature_hofxnoeffqc sfcshp_specificHumidity_hofxnoeffqc sfcshp_stationPressure_hofxnoeffqc

nicholasesposito commented 11 months ago

The GSI has different results. There tends to be more data per variable than JEDI.

I added the GMAO linear obs operators and obs prior filters to the beginning and took out the QC. hofx for winds is 0, or -0 brought back old yaml, tried to change by adding winds to simulated vars, but won't work beause: The list of variables simulated by the obs operator differs from the list of simulated variables

nicholasesposito commented 8 months ago

Issue currently on hold while I"m working on aircraft vertical velocity