search

NOAA-EMC / global-workflow

Global Superstructure/Workflow supporting the Global Forecast System (GFS)
https://global-workflow.readthedocs.io/en/latest
GNU Lesser General Public License v3.0
75 stars 170 forks source link

GFSv16.3.22 - Remove WAFS from GFS #2591

Open KateFriedman-NOAA opened 6 months ago

KateFriedman-NOAA commented 6 months ago

Description

Remove the WAFS (formerly EMC_gfs_wafs) from the GFS, it will now be a standalone system in operations.

WAFS issue: https://github.com/NOAA-EMC/WAFS/issues/23

Target version

v16.3.22

Expected workflow changes

Remove WAFS pieces:

KateFriedman-NOAA commented 4 months ago

Timeline update from @aerorahul :

WAFS has a code delivery in Q1FY25 with an implementation in Q2FY25.
The GFS will be delivered and implemented at the same time removing WAFS from the GFS.
KateFriedman-NOAA commented 4 months ago

This will be v16.4.0

KateFriedman-NOAA commented 2 months ago

Created branch: https://github.com/NOAA-EMC/global-workflow/tree/release/gfs.v16.3.18

KateFriedman-NOAA commented 1 month ago

Just renamed the release branch to release/gfs.v16.3.21 to match the new version in ops. The ARFC for GFSv16.3.19 took the version number and the obsproc/v1.3 update will take GFSv16.3.20. Will update release notes and internal version shortly, need to prep release branch for ARFC GFSv16.3.19 first.

RussTreadon-NOAA commented 1 month ago

Thank you @KateFriedman-NOAA for your quick action.

DA team members are meeting this afternoon to make a final decision as to what course of action to take. Submitting an ARFC to place PlanetiQ data in monitor mode is one option. Another option is to let the PlanetiQ data flow into and be assimilated by the GFS. This later option requires no EIB action.

This issue is opened as a "heads up" to EIB in case the DA team goes with the first option.

KateFriedman-NOAA commented 1 month ago

Synced the release/gfs.v16.3.21 branch with dev/gfs.v16 after the GFSv16.3.19 branch was merged into dev/gfs.v16. Also updated the release branch for the new version v16.3.21.

KateFriedman-NOAA commented 1 month ago

Sync merged the recently-handed-off changes for GFSv16.3.20 into the release/gfs.v16.3.21 branch and cut hand-off tag EMC-v16.3.21.

KateFriedman-NOAA commented 1 month ago

CDF submitted to NCO.

KateFriedman-NOAA commented 1 month ago

WAFS CDF was also just submitted to NCO. EVS will also be submitting a companion CDF soon.

KateFriedman-NOAA commented 1 month ago

@YaliMao-NOAA NCO has requested that we increase the walltime of the wafs 0p25 blending job to 40mins in the new WAFSv7.0.0 package. NCO made the change locally in the GFSv16.3.20 install:

I increased the walltime of 
/lfs/h1/ops/para/packages/gfs.v16.3.20/ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_blending_0p25.ecf
from 30 to 40 minutes to match a change Wei made in gfs.v16.3.18. - Diane Stokes

Please make the same increase in the WAFSv7.0.0 package and recut the WAFS hand-off tag. Thanks!

YaliMao-NOAA commented 1 month ago

@KateFriedman-NOAA Thank you for the notification. I am going to check whether it's necessary to increase the walltime in wafsv7.0.0 since blending process is parallel in wafsv7.0.0

KateFriedman-NOAA commented 1 month ago

@YaliMao-NOAA Good point, sounds good, thanks!

KateFriedman-NOAA commented 2 weeks ago

Merge synced the release/gfs.v16.3.20 changes into the release/gfs.v16.3.21 branch and recut the EMC-v16.3.21 tag.

KateFriedman-NOAA commented 2 weeks ago

This is now v16.3.22. The new ops change documented in issue #3082 will go in before this and pushes this to v16.3.22.