NOAA-EMC / GSI

Gridpoint Statistical Interpolation
GNU Lesser General Public License v3.0
64 stars 146 forks source link

Add PREPBUFR Dump Type (T29) in GSI diagnostic files for conventional data #671

Open emilyhcliu opened 6 months ago

emilyhcliu commented 6 months ago

We need to add prepbufr dump type (T29) into GSI diagnostic files for conventional data in gfsda.v16.3+ system. The WDQMS project requires NWP centers to report marine data with buoy and ship in separate CSV output files. The T29 is necessary to identify ship and buoy data.

RussTreadon-NOAA commented 6 months ago

Two questions

  1. What is the deadline for this development?
  2. Who will make the GSI changes?
RussTreadon-NOAA commented 2 months ago

@emilyhcliu : what is the status of this issue?

emilyhcliu commented 2 months ago

@RussTreadon-NOAA This issue is for WDQMS development. We are delivering observation quality and information for radiosonde, marine and surface data (over land) to WMO. Recently, we have added the WDQMS processing into global-workflow, so the WMO required files from us will be part of our operational products through the gfs.v16.3.16 implementation. The gfs.v16.3.16 is in the hands of NCO for testing and SCN is ready. So, it will be operational soon.This implementation does not involve code changes, only changes in scripts. (The software to extract data from diagnostic files and create the reports for WMO is written by Python).

Back to this issue. Based on WMO WDQMS guidline, we need to deliver the marine in ship and buoy separately. The information in the diagnostic file is not enough for us to separate ship and byou from the marine data. This requires code changes in GSI. We need to add more data into diagnostic files.

emilyhcliu commented 2 months ago

I will add the changes. The changes will not change any scientific results, but will change WDQMS product (one file becomes two files (marine --> ship and buoy) We could include this into v17 implementation or the obs upgrade before v17.

RussTreadon-NOAA commented 2 months ago

Thank you @emilyhcliu for the detailed update. Your last comment read my mind. I'll add this issue to the GFS v17 milestone with the understanding that the code changes may go operational prior to GFS v17.