Validation of [3D]-RTMA ADPUPA Data Generated Using the bufr2ioda

JCSDA-internal / ioda-converters

Various converters for getting obs data in and out of IODA

8 stars 2 forks source link

Validation of [3D]-RTMA ADPUPA Data Generated Using the bufr2ioda #1451

Closed PraveenKumar-NOAA closed 4 months ago

PraveenKumar-NOAA commented 5 months ago

Description

The purpose of this issue is to validate the [3D]-RTMA ADPUPA data generated using the YAML in https://github.com/JCSDA-internal/ioda-converters/issues/1450
The output NetCDF files are generated using the following BUFR file/subset: rtma.t00z.prepbufr.tm00/ ADPUPA rtma.t00z.adpupa.tm00.bufr_d and NC002001
The input BUFR and output NetCDF file will be plotted using Python and other tools, and statistical analysis will be performed for the comparison
The temperature, wind, and pressure obs will be used for the validation

Requirements

bufr2ioda.x
Plotting script(s) to plot BUFR and NetCDF files

Acceptance Criteria (Definition of Done)

Agreement between the BUFR and NetCDF data

Dependencies

There are no dependencies

PraveenKumar-NOAA commented 5 months ago

ADPUPA BUFR Validation: plots were created using the input BUFR and output IODA/NetCDF files for the following observations: temperature, pressure, and wind.

Temperature plots: BUFR bufr_rtma_adpupa_temp

IODA ioda-rtma_adpupa_temp

Thera were 23297 missing values in the IODA file, and statistics are similar.

Pressure plots: BUFR bufr_rtma_adpupa_pressure

IODA ioda-rtma_adpupa_pressure

Number of total Location 30843 Thera were 19644 missing values in the IODA file, and statistics are similar.

Wind plots: BUFR bufr_rtma_adpupa_wind

IODA ioda-rtma_adpupa_wind

Number of total Location 30843 Thera were 22572 missing values in the IODA file, and statistics are similar.

PraveenKumar-NOAA commented 5 months ago

ADPUPA prepBUFR Validation: plots were created using the input BUFR and output IODA/NetCDF files for the following observations: temperature.

Temperature plots: BUFR bufr_rtma_prepbufr_adpupa_temp (3)

IODA ioda_rtma_prepbufr_adpupa_temp

PraveenKumar-NOAA commented 5 months ago

@MatthewMorris-NOAA please look at these validation plots for the [3D]-RTMA ADPUPA BUFR and prepBUFR data.

MatthewMorris-NOAA commented 5 months ago

@PraveenKumar-NOAA The figures look good, but I'm curious about the large # of missing values in the IODA files compared to the BUFR files. What is the cause of this?

PraveenKumar-NOAA commented 5 months ago

@PraveenKumar-NOAA The figures look good, but I'm curious about the large # of missing values in the IODA files compared to the BUFR files. What is the cause of this?

@MatthewMorris-NOAA I can understand your concern. A group_by variable field is required to use in these YMALs, which creates these extra missing values.