NOAA-EMC / WAFS

1 stars 5 forks source link

Bugzilla 1226 - Eliminate the duplicated dbn_alert for unblended gfs wafs data #65

Closed KateFriedman-NOAA closed 2 weeks ago

KateFriedman-NOAA commented 3 weeks ago

From bugzilla 1226:

For the 0p25 degree gfs wafs data: The gfs.tCCz.wafs_0p25_unblended.fHH.grib2 file is sent out the public through dbn_alert from the gfs_atmos_wafs_grib2_0p25 job, if there is missing UK blended data, the same data is alert out again from the gfs_atmos_wafs_blending_0p25 job with same alert type. And the idx file is alert out in the second time, but not in the first time from in the gfs_atmos_wafs_grib2_0p25

Example alert:

095616: type=MODEL subtype=GFS_WAFS_0P25_UBL_GB2 job=jgfs_atmos_wafs_grib2_0p25_06 path=/gpfs/dell1/nco/ops/com/gfs/prod/gfs.20210330/06/atmos/gfs.t06z.wafs_0p25_unblended.f36.grib2
104005: type=MODEL subtype=GFS_WAFS_0P25_UBL_GB2 job=jgfs_atmos_wafs_blending_0p25_06 path=/gpfs/dell1/nco/ops/com/gfs/prod/gfs.20210330/06/atmos/gfs.t06z.wafs_0p25_unblended.f36.grib2
104005: type=MODEL subtype=GFS_WAFS_0P25_UBL_GB2_WIDX job=jgfs_atmos_wafs_blending_0p25_06 path=/gpfs/dell1/nco/ops/com/gfs/prod/gfs.20210330/06/atmos/gfs.t06z.wafs_0p25_unblended.f36.grib2.idx

For the 1.25 degree files: the wmo/grib2.tCCz.wafs_grb_wifsfHH.45 file is sent out from the gfs_atmos_wafs_grib2 job, then if the blended UK data is missing, it is sent out again from the gfs_atmos_wafs_blending job, but with different alert type;

100005: type=MODEL subtype=GFS_WAFSA_GB2 job=jgfs_atmos_wafs_grib2_06 path=/gpfs/dell1/nco/ops/com/gfs/prod/gfs.20210330/06/atmos/wmo/grib2.t06z.wafs_grb_wifsf36.45
104403: type=NTC_LOW subtype=gfs job=jgfs_atmos_wafs_blending_06 path=/gpfs/dell1/nco/ops/com/gfs/prod/gfs.20210330/06/atmos/wmo/grib2.t06z.wafs_grb_wifsf36.45

The duplicated alert for the same files cause some confusion and increase the network traffice for dbnet.  Please check all the above four wafs jobs to see if the duplicated dbn_alert for the same file can be eliminate. Also please review the alert of the index file to see if it needs it, if so where it should be alert? As currently it is not alert out regually, unless there is blended dat amissing.
YaliMao-NOAA commented 2 weeks ago

@KateFriedman-NOAA 1.25 blending has retired and is going to be cleaned up in WAFSv7.0 0.25 blending has been addressed in PR #69

KateFriedman-NOAA commented 1 week ago

Thanks @YaliMao-NOAA ! It's good we have that documented in this issue now. If you haven't already, please note that in the bugzilla and then NCO can review and close it.

YaliMao-NOAA commented 1 week ago

Thank you for the reminder. I will update your spreadsheet too.