Move NCEPLibs release build to shared location (not in user folders)

[rsdunlapiv]

On preconfigured platforms, NCEPLibs should be installed in shared/central locations (and not in user space) wherever possible.

[rsdunlapiv]

@climbfuji has a place in mind for Cheyenne.

[climbfuji]

On Cheyenne (same place where all official ufs-weather-model libraries and modules are installed):

/glade/p/ral/jntp/GMTB/tools

On Hera (leveraging as much as possible from EMC's official libraries, e.g. ESMF; ignore the "scratch" in the name):

/scratch1/BMC/gmtb/software

[jedwards4b]

Please be clear - are these to be installed as modules? If so what is the module use path and load command? Is there a bin directory included with chgres_cube and post executables?

[climbfuji]

Yes, there are modulefiles directories underneath with compiler and mpi library version in the path. Please look at the instructions I sent for hera yesterday, it will be the same for cheyenne. And the executables will be in a bin directory that will be added to the search path.

[jedwards4b]

@climbfuji Looking at the current esmf module installed in /glade/p/ral/jntp/GMTB/tools/modulefiles/ it is requiring exact version matches for netcdf, mpt and compiler - I don't think that the matches need to be exact - this will lead to added complication when it's time to update modules - and the requirements for esmf do not match what we are currently testing.

[climbfuji]

We will create a new version of the libraries with the compiler, MPI and netCDF version that you are using. Those will likely change when Cheyenne comes out of the downtime/upgrade Feb 25-29.

On Jan 30, 2020, at 10:31 AM, jedwards4b notifications@github.com wrote:

@climbfuji https://github.com/climbfuji Looking at the current esmf module installed in /glade/p/ral/jntp/GMTB/tools/modulefiles/ it is requiring exact version matches for netcdf, mpt and compiler - I don't think that the matches need to be exact - this will lead to added complication when it's time to update modules - and the requirements for esmf do not match what we are currently testing.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/ufs-community/ufs-mrweather-app/issues/77?email_source=notifications&email_token=AB5C2ROIK3V4MJBT7UTW3LTRAMFFNA5CNFSM4KNZCJZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEKL26LQ#issuecomment-580366126, or unsubscribe https://github.com/notifications/unsubscribe-auth/AB5C2ROBOLPSQ6ELAPCTE33RAMFFNANCNFSM4KNZCJZQ.

[jedwards4b]

If you want this path on cheyenne in the beta01 tag of usf-mrweather-app we need for you to build the libraries and install modules in /glade/p/ral/jntp/GMTB/tools

On Thu, Jan 30, 2020 at 11:09 AM Dom Heinzeller notifications@github.com wrote:

We will create a new version of the libraries with the compiler, MPI and netCDF version that you are using. Those will likely change when Cheyenne comes out of the downtime/upgrade Feb 25-29.

On Jan 30, 2020, at 10:31 AM, jedwards4b notifications@github.com wrote:

@climbfuji https://github.com/climbfuji Looking at the current esmf module installed in /glade/p/ral/jntp/GMTB/tools/modulefiles/ it is requiring exact version matches for netcdf, mpt and compiler - I don't think that the matches need to be exact - this will lead to added complication when it's time to update modules - and the requirements for esmf do not match what we are currently testing.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub < https://github.com/ufs-community/ufs-mrweather-app/issues/77?email_source=notifications&email_token=AB5C2ROIK3V4MJBT7UTW3LTRAMFFNA5CNFSM4KNZCJZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEKL26LQ#issuecomment-580366126>, or unsubscribe < https://github.com/notifications/unsubscribe-auth/AB5C2ROBOLPSQ6ELAPCTE33RAMFFNANCNFSM4KNZCJZQ .

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/ufs-community/ufs-mrweather-app/issues/77?email_source=notifications&email_token=ABOXUGAXXZMIMA6HKNGMFJLRAMJXLA5CNFSM4KNZCJZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEKL65JY#issuecomment-580382375, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABOXUGGSZXENRJVNGBPCQYDRAMJXLANCNFSM4KNZCJZQ .

-- Jim Edwards

CESM Software Engineer National Center for Atmospheric Research Boulder, CO

[climbfuji]

Sure, will do. Need to converge on a compiler version for both intel and gnu, etc. Here is what the ufs-weather-model uses by default on cheyenne. This is also what the regression tests uses and for which we know it works:

INTEL

module load ncarenv/1.3
module load intel/19.0.2
module load mpt/2.19
module load ncarcompilers/0.5.0
module load netcdf/4.6.3

GNU

module load ncarenv/1.3
module load gnu/8.3.0
module load mpt/2.19
module load ncarcompilers/0.5.0
module load netcdf/4.6.3

[jedwards4b]

Our only difference is that we are using netcdf/4.7.1 we can back up - but it might be better if you update

On Fri, Feb 7, 2020 at 10:58 AM Dom Heinzeller notifications@github.com wrote:

Sure, will do. Need to converge on a compiler version for both intel and gnu, etc. Here is what the ufs-weather-model uses by default on cheyenne. This is also what the regression tests uses and for which we know it works:

INTEL

module load ncarenv/1.3 module load intel/19.0.2 module load mpt/2.19 module load ncarcompilers/0.5.0 module load netcdf/4.6.3

GNU

module load ncarenv/1.3 module load gnu/8.3.0 module load mpt/2.19 module load ncarcompilers/0.5.0 module load netcdf/4.6.3

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/ufs-community/ufs-mrweather-app/issues/77?email_source=notifications&email_token=ABOXUGB4Z4ZRZKVL5OPSRPLRBWOK7A5CNFSM4KNZCJZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELD7D7Q#issuecomment-583528958, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABOXUGCLWU2LIUGHBRJFINLRBWOK7ANCNFSM4KNZCJZQ .

-- Jim Edwards

CESM Software Engineer National Center for Atmospheric Research Boulder, CO

[climbfuji]

Ok, that shouldn't make a big difference anyway. THanks!

On Feb 7, 2020, at 11:30 AM, jedwards4b notifications@github.com wrote:

Our only difference is that we are using netcdf/4.7.1 we can back up - but it might be better if you update

On Fri, Feb 7, 2020 at 10:58 AM Dom Heinzeller notifications@github.com wrote:

Sure, will do. Need to converge on a compiler version for both intel and gnu, etc. Here is what the ufs-weather-model uses by default on cheyenne. This is also what the regression tests uses and for which we know it works:

INTEL

module load ncarenv/1.3 module load intel/19.0.2 module load mpt/2.19 module load ncarcompilers/0.5.0 module load netcdf/4.6.3

GNU

module load ncarenv/1.3 module load gnu/8.3.0 module load mpt/2.19 module load ncarcompilers/0.5.0 module load netcdf/4.6.3

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/ufs-community/ufs-mrweather-app/issues/77?email_source=notifications&email_token=ABOXUGB4Z4ZRZKVL5OPSRPLRBWOK7A5CNFSM4KNZCJZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELD7D7Q#issuecomment-583528958, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABOXUGCLWU2LIUGHBRJFINLRBWOK7ANCNFSM4KNZCJZQ .

-- Jim Edwards

CESM Software Engineer National Center for Atmospheric Research Boulder, CO — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/ufs-community/ufs-mrweather-app/issues/77?email_source=notifications&email_token=AB5C2RJKL2R6FZ5CLVDQDC3RBWSD7A5CNFSM4KNZCJZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELECTHY#issuecomment-583543199, or unsubscribe https://github.com/notifications/unsubscribe-auth/AB5C2RLOKPCNO2K4DG7W73LRBWSD7ANCNFSM4KNZCJZQ.

[climbfuji]

Actually, the default on cheyenne nowadays is netcdf/4.7.3 - I assume that's better to use than 4.7.1?

[jedwards4b]

Sure

On Fri, Feb 7, 2020 at 3:17 PM Dom Heinzeller notifications@github.com wrote:

Actually, the default on cheyenne nowadays is netcdf/4.7.3 - I assume that's better to use than 4.7.1?

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/ufs-community/ufs-mrweather-app/issues/77?email_source=notifications&email_token=ABOXUGAXWE63WWZ65JHQPWLRBXMWPA5CNFSM4KNZCJZ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELE2LQY#issuecomment-583640515, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABOXUGHRWMZB4PKHY7PFI23RBXMWPANCNFSM4KNZCJZQ .

-- Jim Edwards

CESM Software Engineer National Center for Atmospheric Research Boulder, CO

[climbfuji]

I created those libraries and modules on Cheyenne for both Intel and GNU. I didn't finish the hera build with the current version of NCEPLIBS-external/NCEPLIBS yet. The notes are on my other laptop, but if someone is desperate trying this out over the weekend, I can post the details here tomorrow (and finish the hera build I believe).

[arunchawla-NOAA]

@rsdunlapiv and @jedwards4b Is this still an issue? I think we have defined pre configured vs supported platforms and are progressing according to the spreadsheet that @climbfuji created

[jedwards4b]

No - I think this is resolved.

[climbfuji]

I agree.