search

NOAA-EMC / hpc-stack

Create a software stack for HPC's
GNU Lesser General Public License v2.1
30 stars 36 forks source link

Installation Request: g2c/1.6.0 on WCOSS #56

Closed malloryprow closed 3 years ago

malloryprow commented 3 years ago

I am working with NCO to get MET (https://github.com/dtcenter/MET) version 9.1.0 into operations. It was discovered when compiling MET with g2c/1.5.0 on both the Dell and Cray lead to a problem to arise. When MET is compiled with g2c/1.6.0, the problem goes away. I am requesting for g2c/1.6.0 to be installed on all WCOSS machines.

edwardhartnett commented 3 years ago

@Hang-Lei-NOAA @BoiVuong-NOAA what's the current version of g2c in hpc_stack?

Hang-Lei-NOAA commented 3 years ago

In the testing version hpc-stack installed all dell, wcoss2, hera and orion, it is v1.6.2 above the required one.

On Thu, Nov 12, 2020 at 2:32 PM Edward Hartnett notifications@github.com wrote:

@Hang-Lei-NOAA https://github.com/Hang-Lei-NOAA @BoiVuong-NOAA https://github.com/BoiVuong-NOAA what's the current version of g2c in hpc_stack?

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/NOAA-EMC/hpc-stack/issues/56#issuecomment-726292490, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKWSMFHHFZOZRGAIEZCT6JDSPQZ33ANCNFSM4TTN5DSA .

Hang-Lei-NOAA commented 3 years ago

On WCOSS Dell module use /usrx/local/nceplibs/dev/hpc-stack/test/hpc-stack/modulefiles/stack module load hpc/1.0.0-beta1 module load hpc-ips/18.0.1.163 module load hpc-impi/18.0.1

This testing version contains g2c_v1.6.2 It is a version that we fixed the issue caused by jasper update upon v1.6.0 It should well solve your issue.

aerorahul commented 3 years ago

@Hang-Lei-NOAA Can you please open a PR so that hpc-stack develop can build g2c

malloryprow commented 3 years ago

Thanks for the paths @Hang-Lei-NOAA! The MET installation is going to be going in under nwprod. Do you know if NCO allows these modules to be used by software going in under nwprod?

Hang-Lei-NOAA commented 3 years ago

Okay, I try to bring the testing version back to develop soon.

Hang-Lei-NOAA commented 3 years ago

The testing version of hpc-stack is addressing NCO concerns, they have been testing it on WCOSS2 and Dell with using their third party libs.

aerorahul commented 3 years ago

That should be a separate PR.

Hang-Lei-NOAA commented 3 years ago

Okay, I will make it in a separate PR.

Hang-Lei-NOAA commented 3 years ago

The g2c_v1.6.2 does not contain any functional changes above v1.6.0. The 1.6.0 only works with old jasper versions, and report bug with new jasper versions. We updated it to work with new jasper version and Documentation is also added by Ed. The use of g2c/1.6.2 is equal to g2c/1.6.0 in MET.

malloryprow commented 3 years ago

I'm a little confused here. Can the loading the hpc stack be used in code that will be installed under nwprod? On the current production machine (Venus), I am not seeing anything under /usrx/local/nceplibs/dev/hpc-stack/test/hpc-stack/modulefiles/stack. We need to have g2c/1.6.0 or g2c/1.6.2 accessible on both the prod and dev machine as the MET code is going to be installed in operations (under nwprod) like how g2c/1.5.0 is on both machines now. It is also needed on the Crays, not just the Dells.

Hang-Lei-NOAA commented 3 years ago

NCO is still testing. It has been on wcoss2 under nwprod. They tend to maintain the old operational libs on other machines now. Not sure if they are going to change later.

On Mon, Nov 16, 2020 at 1:21 PM malloryprow notifications@github.com wrote:

I'm a little confused here. Can the loading the hpc stack be used in code that will be installed under nwprod? On the current production machine (Venus), I am not seeing anything under /usrx/local/nceplibs/dev/hpc-stack/test/hpc-stack/modulefiles/stack. We need to have g2c/1.6.0 or g2c/1.6.2 accessible on both the prod and dev machine as the MET code is going to be installed in operations (under nwprod) like how g2c/1.5.0 is on both machines now. It is also needed on the Crays, not just the Dells.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/NOAA-EMC/hpc-stack/issues/56#issuecomment-728239798, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKWSMFAO6B2WCZRWVKDTFTLSQFUUFANCNFSM4TTN5DSA .

Hang-Lei-NOAA commented 3 years ago

The hpc-stack cannot be installed on cray, it does not has LMOD. I will check cray and install the missing single libs on cray. Cray will retire next year. We will sync the same testing installations on Venus.

On Mon, Nov 16, 2020 at 1:25 PM Hang Lei - NOAA Affiliate hang.lei@noaa.gov wrote:

NCO is still testing. It has been on wcoss2 under nwprod. They tend to maintain the old operational libs on other machines now. Not sure if they are going to change later.

On Mon, Nov 16, 2020 at 1:21 PM malloryprow notifications@github.com wrote:

I'm a little confused here. Can the loading the hpc stack be used in code that will be installed under nwprod? On the current production machine (Venus), I am not seeing anything under /usrx/local/nceplibs/dev/hpc-stack/test/hpc-stack/modulefiles/stack. We need to have g2c/1.6.0 or g2c/1.6.2 accessible on both the prod and dev machine as the MET code is going to be installed in operations (under nwprod) like how g2c/1.5.0 is on both machines now. It is also needed on the Crays, not just the Dells.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/NOAA-EMC/hpc-stack/issues/56#issuecomment-728239798, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKWSMFAO6B2WCZRWVKDTFTLSQFUUFANCNFSM4TTN5DSA .

malloryprow commented 3 years ago

Okay, we are hoping to get MET installed on WCOSS now and not wait until WCOSS2. Since we also need g2c/1.6.0 or g2c/1.6.2 on the Crays, it sounds like using the hpc-stack isn't going to work. Sorry about this, I thought I doing the correct procedure to get new/updated installations of libraries on WCOSS following Arun's "NCEP Library requests" email on 11/10/2020.

Hang-Lei-NOAA commented 3 years ago

If your work is related to the implementation of GFSv16, of course, you need to use the GFSv16 supporting library. These libs were pushed to NCO two months ago. But, if you are toward the development of GFSv17 and future development, you need to use hpc-stack. Arun's "NCEP Library requests" is for the work after the GFSv16 implementation.

On Mon, Nov 16, 2020 at 1:33 PM malloryprow notifications@github.com wrote:

Okay, we are hoping to get MET installed on WCOSS now and not wait until WCOSS2. Since we also need g2c/1.6.0 or g2c/1.6.2 on the Crays, it sounds like using the hpc-stack isn't going to work. Sorry about this, I thought I doing the correct procedure to get new/updated installations of libraries on WCOSS following Arun's "NCEP Library requests" email on 11/10/2020.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/NOAA-EMC/hpc-stack/issues/56#issuecomment-728246017, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKWSMFEGBNZ644GD34CI7ALSQFV6NANCNFSM4TTN5DSA .

malloryprow commented 3 years ago

This isn't related to any specific model implementation, but for wider verification use for all models as verification codes transition to using METplus.