NOAA-EMC / hpc-stack

Create a software stack for HPC's
GNU Lesser General Public License v2.1
30 stars 36 forks source link

[INSTALL] HDF5 1.14.0 #513

Open junwang-noaa opened 1 year ago

junwang-noaa commented 1 year ago

Note: Please search to see if an issue already exists for the software you are requesting to be installed.

Which software in the stack would you like installed? HDF5 1.14.0 on all the UFS supported platforms.

What is the version/tag of the software? 1.14.0

What compilation options would you like set? Same as HDF5 1.10.6

Which machines would you like to have the software installed? wcoss2, acorn, hera, orion, jet, gaea, cheyenne.

Any other relevant information that we should know to correctly install the software?? Several libraries that have dependency on HDF5 need to be reinstalled including: NetCDF (4.9.0 or 4.9.1), ESMF 8.4.0 and MAPL 2.23.1.

Additional context Add any other context or screenshots about the install request here.

Hang-Lei-NOAA commented 1 year ago

@junwang-noaa According to the discussion with @edwardhartnett, the release of netcdf-c-4.9.1 may wait for months. So, we have installed the hdf5/1.14.0 with netcdf-c-4.9.0 series (netcdf-fortran4.6.0; netcdf-cxx 4.3.1) and associated mapl etc libs on Hera and Acorn. Hera location (hpc-stack loading) : /scratch2/NCEPDEV/nwprod/hpc-stack/libs/hpc-stack-gfsv16

Acorn location: module use /lfs/h1/emc/nceplibs/noscrub/Hang.Lei/works/libs/modulefiles/mpi/intel/19.1.3.304/cray-mpich/8.1.9

junwang-noaa commented 1 year ago

@Hang-Lei-NOAA Thank you for installing the library on hera/acorn. Please let us know when the library is available on wcoss2. @DusanJovic-NOAA FYI.

Hang-Lei-NOAA commented 1 year ago

If we need to deliver the netcdf and hdf5 code to NCO for installation, two concerns:

1, Please UFS test them and make sure these are working fine. and confirmed with me, then I will start the delivery. 2, There may have conflicts with existing netcdf/4.9.0, which already installed on wcoss2. We need communicate with them on how to deal with this.

On Wed, Feb 1, 2023 at 7:42 AM Jun Wang @.***> wrote:

@Hang-Lei-NOAA https://github.com/Hang-Lei-NOAA Thank you for installing the library on hera/acorn. Please let us know when the library is available on wcoss2. @DusanJovic-NOAA https://github.com/DusanJovic-NOAA FYI.

— Reply to this email directly, view it on GitHub https://github.com/NOAA-EMC/hpc-stack/issues/513#issuecomment-1411995834, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKWSMFGXLXRGJKSRINFMVITWVJKZ3ANCNFSM6AAAAAAUD6EM7E . You are receiving this because you were mentioned.Message ID: @.***>

Hang-Lei-NOAA commented 1 year ago

I have updated the installation of hdf5 /1.14.0 with NETCDF/4.9.1 on hera installation.

edwardhartnett commented 1 year ago

@hang does the netcdf-c-4.9.1 suffer the same problems with UFS as 4.9.0? Or are they fixed?

We really shouldn't need 4.9.0 and 4.9.1, everyone should just use 4.9.1. But is that OK with @junwang-noaa ?

Hang-Lei-NOAA commented 1 year ago

@edwardhartnett The previous reported tests on Hera seems fine. But I am working on Acorn to solve a series of associated possible issues with the UFS failure that Pan Li reported. My first fix is to get the esmf 8.4.0 external working, then get the netcdf updated, then to fix the mapl/2.34.0 installation. Then I will repeat Pan LI's UFS tests.

junwang-noaa commented 1 year ago

@hang does the netcdf-c-4.9.1 suffer the same problems with UFS as 4.9.0? Or are they fixed?

We really shouldn't need 4.9.0 and 4.9.1, everyone should just use 4.9.1. But is that OK with @junwang-noaa ?

@edwardhartnett Just to confirm that we are going to use 4.9.1? Also may I ask what is the problem in UFS with 4.9.0? If netcdf 4.9.1 is working with current UFS test, we can update 4.9.1 and start to update the code to get the new features. My understanding is that netcdf 4.9.0 is backward compatible.

edwardhartnett commented 1 year ago

Both 4.9.0 and 4.9.1 are backward compatible. So both should work.

But yesterday Hang mentioned some problem with running the UFS and netcdf-c-4.9.0. I don't have the details.

Certainly we should use 4.9.1, it has bugfixes in the quantize/compress code, and we want those.