AVHRR Obs Validation - Githubissues

NOAA-EMC / JEDI-T2O

JEDI Transition to Operations activities.

GNU Lesser General Public License v2.1

5 stars 4 forks source link

AVHRR Obs Validation #53

Open azadeh-gh opened 1 year ago

azadeh-gh commented 1 year ago

Need to validate observations from AVHRR and evaluate QC procedures in the AVHRR YAML file, as a AVHRR YAML file already exists in the GDASApp.

This issue will be used to track progress on validation of radiances in UFO for GDAS in four stages:

[x] HofX computation using GSI produced GeoVaLs
[x] QC count checks (and YAML changes) using GSI produced GeoVaLs (see comment)
[x] Obs errors using GSI produced GeoVaLs (see comment)
[ ] HofX computation in FV3-JEDI

azadeh-gh commented 1 year ago

Naming issue: geoval and obs files name is avhrr but the name in bc is avhrr3, so cannot run the run_ufo_hofx script by using one name for obstype, I used avhrr for obstype name and inserted avhrr3_n18 in copy BC files part of the code. QC filters: Used Andrew's updated geoval to have : 1) "VarMetaData" in naming 2) Correct troposphere pressure unit. GeoDir=/work2/noaa/da/acollard/UFO_eval/data/gsi_geovals_l127/nofgat_aug2021/20221013/geovals/

Used Andrew's updated obs file for corrected obs errors: ObsDir=/work2/noaa/da/acollard/UFO_eval/data/gsi_geovals_l127/nofgat_aug2021/20221013/obs/

emilyhcliu commented 1 year ago

Move the contents of issue #56 to this issue.

emilyhcliu commented 1 year ago

Revisit AVHRR QC

[x] Prepare updated test input dataset (obs and geoval files)
[x] Test with the new input dataset
[x] Update YAMLs with the latest UFO features

QC flowchart for AVHRR - similar to IASI/CrIS

AVHRR-QC-Flowchart pptx

emilyhcliu commented 1 year ago

AVHRR data available for the QC and Obs Error validation period (2021080100)

[x] NOAA-18 --- 100% replication
[x] NOAA-19 --- ~100% one observation difference, likely due to numerical round-off error
[x] MetOp-A --- 100% replication
[x] MetOp-B --- 100% replication

Final QC and Observation Error Comparison between UFO and GSI (using AVHRR N19 and MetOp-A as examples)

AVHRR NOAA-19

UFO Channel 3 ufo_avhrr3_n19_channel3 GSI Channel 3 gsi_avhrr3_n19_channel3

UFO Channel 4 ufo_avhrr3_n19_channel4 GSI Channel 4 gsi_avhrr3_n19_channel4

UFO Channel 5 ufo_avhrr3_n19_channel5 GSI Channel 5 gsi_avhrr3_n19_channel5

AVHRR MetOp-A

UFO Channel 3 ufo_avhrr3_metop-a_channel3 GSI Channel 3 gsi_avhrr3_metop-a_channel3

UFO Channel 4 ufo_avhrr3_metop-a_channel4 GSI Channel 4 gsi_avhrr3_metop-a_channel4

UFO Channel 5 ufo_avhrr3_metop-a_channel5 GSI Channel 5 gsi_avhrr3_metop-a_channel5