search

ComputeCanada / software-stack-config

8 stars 3 forks source link

Set I_MPI_EXTRA_FILESYSTEM=on in Intel MPI #44

Open bartoldeman opened 1 year ago

bartoldeman commented 1 year ago

Suggested by Eric Chamberland in a ticket.

bartoldeman commented 1 year ago

@ericch1 FYI

ericch1 commented 1 year ago

Thanks for the info! I think it can me a big difference for users using MPI IO aware libraries/softwares.

@vanzonr

ericch1 commented 1 year ago

In the same way, I have been unable to use MPI IO hints with OpenMPI 4.0.3.

With 4.1.1 it seems ok. So I will surely ask soon to rebuild a PETSc version to switch to a more recent OpenMPI version. I am waiting to see the conclusion of this OpenMPI ticket:

https://github.com/open-mpi/ompi/issues/10132

mboisson commented 1 year ago

Interesting. I wonder why it is off by default ? Doesn't make a whole lot of sense for MPI

bartoldeman commented 1 year ago

Good question. Should test this a little to see what happens on non-Lustre/GPFS fs, if it complains or not.

ericch1 commented 1 year ago

Maybe here is a clue:

https://community.intel.com/t5/Intel-oneAPI-HPC-Toolkit/Intel-MPI-v2019-options-responding-v2018/m-p/1178900/highlight/true#M6706

They are talking about a bug with GPFS in Intel MPI Library 2019 Update 5... Would worth to take care in fact where and when this is activated...