Validation of High-Res Radiosonde Cloud Data Generated Using bufr2ioda

JCSDA-internal / ioda-converters

Various converters for getting obs data in and out of IODA

9 stars 4 forks source link

Validation of High-Res Radiosonde Cloud Data Generated Using bufr2ioda #1203

Closed PraveenKumar-NOAA closed 2 months ago

PraveenKumar-NOAA commented 1 year ago

Description

The purpose of this issue is to validate the High-Res Radiosonde cloud data generated using the YAML in #1184.
The output NetCDF file is generated using the following BUFR file: | NC002101 | A51101 | MSG TYPE 002-101 RAWINSONDE - FIXED LAND (BUFR) |
The input BUFR and output NetCDF file will be plotted using Python and other tools, and statistical analysis will be performed for the comparison.
The cloudAmount (CLAM) will be used for the validation.

Requirements

Plotting script to plot BUFR and NetCDF files.

Acceptance Criteria (Definition of Done)

Agreement between the BUFR and NetCDF data.

Dependencies

There are no dependiencies.

PraveenKumar-NOAA commented 1 year ago

Plots for the cloudAmount obs are generated using the input BUFR and output NetCDF files:

BUFR plot: bufr_nc002101_cloudAmount

IODA plot: ioda-cloudAmount_nc002101

The extra number of counts in IODA plot is coming from the missing values.

PraveenKumar-NOAA commented 1 year ago

@emilyhcliu @MatthewMorris-NOAA I generated these plots for the high-res radiosonde cloud data. Once you agree with these plots, I will submit a PR.

PraveenKumar-NOAA commented 1 year ago

Plots for the heightOfBaseOfCloud obs generated using the input BUFR and output NetCDF files:

BUFR plot: bufr_nc002101_heightOfBaseOfCloud

IODA plot: ioda-heightOfBaseOfCloud_nc002101

liujake commented 1 year ago

@PraveenKumar-NOAA I am curious: where come from those cloud observations of radiosondes? We (at NCAR MPAS-JEDI team) are interested in those cloud data? Somewhere I can find related information?

PraveenKumar-NOAA commented 1 year ago

@liujake this information is in our BUFR. In the plots above, I used, RAWINSONDE - FIXED LAND (NC002101) BUFR data files.

MatthewMorris-NOAA commented 1 year ago

@PraveenKumar-NOAA The figures look good, in general, but I'm curious about the extra observations in the IODA figures (e.g., in South America). Do you know the cause of these extra obs?

emilyhcliu commented 1 year ago

@KumarPraven The observation counts between the BUFR and the IODA should match. Let's figure out why they don't match and fix it first. It could be issue in the plotting not in the bufr converter.

BenjaminRuston commented 5 months ago

@PraveenKumar-NOAA is this still being worked on

PraveenKumar-NOAA commented 5 months ago

@BenjaminRuston yes, I am workin on a related issue.

PraveenKumar-NOAA commented 2 months ago

Closing this issue, this will be dealt separately with the High-Res Radiosonde global data!