c-scale-community / workflow-coastal-hydrowaq

Porting and deploying the HiSea use case on C-SCALE
Apache License 2.0
3 stars 1 forks source link

configure container to use the MPI library installed on HPC. #24

Closed lorincmeszaros closed 2 years ago

lorincmeszaros commented 2 years ago

@avgils @backeb I confirmed internally that Deltares has a container that can use the MPI library at the Host, we have this for the 2022.02 release. Yvonne will send the container with instructions to Anna.

@nikosT @kkoumantaros : Do you have IntelMPI installed at the cluster and (if yes) which version it is? When we try to set this up, will you have a sysadmin help us out? Who should be the contact person?

nikosT commented 2 years ago

@lorincmeszaros Yes, we do. We have various versions of it. Is intelmpi/2018 suitable for you? Yes, you can always send an e-mail at support at hpc.grnet.gr and an admin will be answering back to you.

lorincmeszaros commented 2 years ago

Thanks @nikosT ! We can try with the older one but it was only tested with IntelMPI 2021.2 and 2021.4.

@avgils

nikosT commented 2 years ago

@lorincmeszaros, you can also load the oneAPI module, which includes the intelMPI 2021.4.

lorincmeszaros commented 2 years ago

this is what we see (2021.3):

MicrosoftTeams-image (1)

nikosT commented 2 years ago

@lorincmeszaros Could you try:

module purge
module load oneAPI/2021.3
module avail # see under oneAPI section available modules
module load compiler
module load mpi # this is the intelmpi 
mpiicc --version # intelmpi uses double "i" in commands

which will eventually load intelmpi 2021.3.

You could also try module load oneAPI/2022.1, and then follow the same steps, which will load intelmpi 2021.5.

PS: I was confused with the number versions, where no .4 is installed, however probably both .3 and .5 will suit you.

avgils commented 2 years ago

@nikosT Thanks for this example I see intelmpi 2021.3.0 :)

lorincmeszaros commented 2 years ago

@nikosT

@avgils submitted jobs to test the mpi library but stuck in the queue. Do you have recommendation how to jump the queue? Using test queue for short runs or similar?

nikosT commented 2 years ago

@lorincmeszaros, generally, you can not jump in the queue, in terms of fairness. However, you could use partition el7thin with 2 allocated nodes.