Open jscook2345 opened 1 year ago
If it helps, this is on Perlmutter: https://www.nersc.gov/systems/perlmutter/
How did you build Charm++ (./build charm++ mpi-crayshasta ?), what modules are you using (PrgEnv, mpi, etc.), and what is your run command?
Build (tag v7.0.0):
./build charm++ mpi-crayshasta -g
cd mpi-crayshasta/examples/charm++/hello/1darraymsg
make
Modules:
craype-x86-milan
libfabric/1.15.2.0
craype-network-ofi
xpmem/2.5.2-2.4_3.30__gd0f7936.shasta
PrgEnv-gnu/8.3.3
cray-dsmml/0.2.2
cray-libsci/23.02.1.1
cray-mpich/8.1.24
craype/2.7.19
gcc/11.2.0
perftools-base/23.02.0
cpe/23.02
xalt/2.10.2
cpu/1.0
cray-pmi/6.1.9
craype-hugepages8M
Run:
srun -C cpu -q debug -N 2 -n 2 --ntasks-per-node=1 -c 256 ./hello 2000000
That all looks correct. It looks to me like an issue in cray-mpich or libfabric below it since the parameters passed into the MPI_Iprobe() call all look to be valid. You could maybe try reproducing the error in a standalone MPI_Iprobe test program using the same environment?
I'll give that a try. Thanks for the initial look.
If I wanted to hook up a parallel debugger like ddt or totalview, do I need to do anything different because of kokkos?
Thanks,
Justin
Hello,
I'm getting the following error when running one of the charm++ examples. Was looking for some guidance on how to debug the issue or ideas on what to try next.
Thanks,
Justin