search

NOAA-EMC / global-workflow

Global Superstructure/Workflow supporting the Global Forecast System (GFS)
https://global-workflow.readthedocs.io/en/latest
GNU Lesser General Public License v3.0
70 stars 161 forks source link

Staging the fix file for SOCA #2707

Open apchoiCMD opened 1 week ago

apchoiCMD commented 1 week ago

Target fix directory

NEW

Type of change

Any workflow changes needed?

No change needed

Related issues

https://github.com/NOAA-EMC/GDASApp/issues/1120

bkgerr folder should NOT be included from pickup location

Pickup location

/work/noaa/da/marineda/gfs-marine/data/static

Size

0

WalterKolczynski-NOAA commented 6 days ago 
ls: cannot access '/work/noaa/da/marineda/gfs-marine/data/static': Permission denied
apchoiCMD commented 6 days ago

@WalterKolczynski-NOAA Sorry for your inconvenience- I've changed the permissions so you will be able to access the folders/files

WalterKolczynski-NOAA commented 6 days ago

Are these going in a new directory or an existing one? The issue description is contradictory.

apchoiCMD commented 4 days ago

Those fix files with various resolutions are needed to copy into/under fix/gdas/soca, this is probably new folder and also ask you not to copy bkferr folder from each resolutions.

guillaumevernieres commented 4 days ago

@WalterKolczynski-NOAA We keep our fix files here:

/work/noaa/da/marineda/gfs-marine/data/static/

under the above directory, we need to copy the following, preserving the symlink if possible:

1440x1080x75
360x320x75
4500x3297x75
72x35x25
common

to glopara:

global/glopara/fix/soca/20240624

So yes, we're creating a new directory.

aerorahul commented 4 days ago

@WalterKolczynski-NOAA @KateFriedman-NOAA Please add this dataset and information to the Fix File Management spreadsheet here

@guillaumevernieres @apchoiCMD Please help fill out the details of the shared dataset as best as possible to help manage and document it when external users request them.

KateFriedman-NOAA commented 3 days ago

@guillaumevernieres @apchoiCMD Please confirm that the bkgerr files should not be included. @apchoiCMD said not to but @guillaumevernieres did not mention them so I'm double checking. Thanks!

apchoiCMD commented 3 days ago

Thanks for your comment @KateFriedman-NOAA , @guillaumevernieres didn't mention it but bkgerr should not included in process of copying the fix files-

KateFriedman-NOAA commented 3 days ago

bkgerr should not included in process of copying the fix files

Great, thanks for the quick reply and confirmation @apchoiCMD ! I am working to pull these new fix files into the primary fix set now.

KateFriedman-NOAA commented 3 days ago

@apchoiCMD I have copied the requested fix files to the fix set on Hera: /scratch1/NCEPDEV/global/glopara/fix/gdas/soca/20240624

Please take a look and confirm they look good in place. Once confirmed, we will sync them to the other supported platforms.

KateFriedman-NOAA commented 3 days ago

@apchoiCMD @guillaumevernieres A new fix version variable will need to be added to versions/fix.ver in global-workflow to use this new fix set. It would be:

export gdas_soca_ver=20240624

Do you have an upcoming PR that you can include this update within? Let me know, thanks!

apchoiCMD commented 3 days ago

@apchoiCMD I have copied the requested fix files to the fix set on Hera: /scratch1/NCEPDEV/global/glopara/fix/gdas/soca/20240624

Please take a look and confirm they look good in place. Once confirmed, we will sync them to the other supported platforms.

Thanks for your work and let me check them out quick-

apchoiCMD commented 3 days ago

@KateFriedman-NOAA I have completed to check the fix files you copied in the new place.

/scratch1/NCEPDEV/global/glopara/fix/gdas/soca/20240624

They look like what they suppose to be- Thanks and sorry for late response to you.

Regarding to an additional PR you mentioned, I think @guillaumevernieres will do with something else or ask me to do-

apchoiCMD commented 3 days ago

@apchoiCMD I have copied the requested fix files to the fix set on Hera: /scratch1/NCEPDEV/global/glopara/fix/gdas/soca/20240624

Please take a look and confirm they look good in place. Once confirmed, we will sync them to the other supported platforms.

@KateFriedman-NOAA Are you going to copy them to Orion machine as well? under /work/noaa/global/glopara/fix/gdas/soca something like this?

KateFriedman-NOAA commented 2 days ago

They look like what they suppose to be Are you going to copy them to Orion machine as well?

Great, thanks for confirming! We'll now sync the new fix/gdas/soca/20240624 to the other platforms. @WalterKolczynski-NOAA please sync to Orion, thanks!

Regarding to an additional PR you mentioned, I think @guillaumevernieres will do with something else or ask me to do-

Ok great!

KateFriedman-NOAA commented 2 days ago

The new gdas/soca/20240624 fix files have been synced to both WCOSS2s, Jet, and AWS. Working on HPSS still.

apchoiCMD commented 2 days ago

The new gdas/soca/20240624 fix files have been synced to both WCOSS2s, Jet, and AWS. Working on HPSS still.

Thanks for letting us know @KateFriedman-NOAA , I will take a look at least on WCOSS2-

KateFriedman-NOAA commented 2 days ago

The new gdas/soca/20240624 fix set is also now saved on HPSS: /5year/NCEPDEV/emc-global/emc.glopara/fix/fix.gdas.soca.20240624.tar.xz