search

NOAA-EMC / global-workflow

Global Superstructure/Workflow supporting the Global Forecast System (GFS)
https://global-workflow.readthedocs.io/en/latest
GNU Lesser General Public License v3.0
75 stars 168 forks source link

rocoto_viewer.py on WCOSS not working now without Gyre #41

Closed CoryMartin-NOAA closed 4 years ago

CoryMartin-NOAA commented 4 years ago

CRITICAL ERROR: The produtil package could not be loaded from your system

Lines 194-199 of rocoto_viewer.py:

    PRODUTIL = collections.defaultdict(list)
    PRODUTIL['hera'] = '/scratch1/NCEPDEV/global/glopara/svn/nceplibs/produtil/trunk/ush'
    PRODUTIL['luna']  = '/gpfs/hps3/emc/global/noscrub/emc.glopara/svn/nceplibs/produtil/trunk/ush'
    PRODUTIL['tide']  = '/gpfs/td1/emc/global/save/emc.glopara/svn/nceplibs/produtil/trunk/ush'
    PRODUTIL['gyre']  = '/gpfs/gd1/emc/global/save/emc.glopara/svn/nceplibs/produtil/trunk/ush'
    try_clusters = ('hera','luna','tide','gyre')
CoryMartin-NOAA commented 4 years ago

Sorry, the issue is actually because surge is unmounted I believe.

RussTreadon-NOAA commented 4 years ago

Yes, you are correct. Surge is offline today so we can't get to

/gpfs/hps3/emc/global/noscrub/emc.glopara/svn/nceplibs/produtil/trunk/ush

On Thu, Mar 26, 2020 at 10:15 AM Cory Martin notifications@github.com wrote:

Sorry, the issue is actually because surge is unmounted I believe.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/NOAA-EMC/global-workflow/issues/41#issuecomment-604455244, or unsubscribe https://github.com/notifications/unsubscribe-auth/AGNN6326IPQECSGS56CS56LRJNPP7ANCNFSM4LUIJFMQ .

CoryMartin-NOAA commented 4 years ago

@RussTreadon-NOAA is there an equivalent directory on Venus somewhere? If so, I can modify the gfsv16b version of this file to support it working without the cray.

KateFriedman-NOAA commented 4 years ago

@CoryMartin-NOAA I can set up a Dell copy...stay tuned...

RussTreadon-NOAA commented 4 years ago

We could copy /gpfs/td1/emc/global/save/emc.glopara/svn/nceplibs/produtil (Tide fileset) to Venus or Mars. It's better to contact EIB workflow team or nceplibs team to respond & correct.

On Thu, Mar 26, 2020 at 10:20 AM Cory Martin notifications@github.com wrote:

@RussTreadon-NOAA https://github.com/RussTreadon-NOAA is there an equivalent directory on Venus somewhere? If so, I can modify the gfsv16b version of this file to support it working without the cray.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/NOAA-EMC/global-workflow/issues/41#issuecomment-604457705, or unsubscribe https://github.com/notifications/unsubscribe-auth/AGNN635CZEXPN6WUHIOP2ULRJNQA7ANCNFSM4LUIJFMQ .

CoryMartin-NOAA commented 4 years ago

Thanks @KateFriedman-NOAA, I cloned a local version of pyprodutil for me to use for now, but I'll switch to the permanent paths once they exist on Dell.

KateFriedman-NOAA commented 4 years ago

@CoryMartin-NOAA I pulled over the Luna copy to Mars and then Venus. Please try this and if it works I can update the paths in rocoto_viewer.py.

/gpfs/dell2/emc/modeling/noscrub/emc.glopara/svn/nceplibs/produtil

KateFriedman-NOAA commented 4 years ago

Created branch hotfix/viewer to update produtil paths on WCOSS.

CoryMartin-NOAA commented 4 years ago

@KateFriedman-NOAA Using that path (well after adding /trunk/ush) seems to work. It's a bit slow to respond but I don't know if that is because of the pyprodutil or because of the scheduler/filesystem.

KateFriedman-NOAA commented 4 years ago

@CoryMartin-NOAA The filesystem has been somewhat slow on WCOSS recently...was it faster using your local install of pyprodutil?

CoryMartin-NOAA commented 4 years ago

@KateFriedman-NOAA no I tried with both, seems to be similarly slow. I think it's safe to use: /gpfs/dell2/emc/modeling/noscrub/emc.glopara/svn/nceplibs/produtil//trunk/ush

KateFriedman-NOAA commented 4 years ago

@CoryMartin-NOAA Ok great, thanks! I have made the path changes to the viewer in the hotfix branch. It is working on Venus. I'll initiate a PR shortly.

KateFriedman-NOAA commented 4 years ago

Initiated PR #42

KateFriedman-NOAA commented 4 years ago

Thank you @CoryMartin-NOAA for reporting this bug via a GitHub issue and for testing the fix!

PR has been completed and hotfix/viewer branch deleted. Closing issue and sending commit announcement.