search

GlobalArrays / ga

Partitioned Global Address Space (PGAS) library for distributed arrays
http://hpc.pnl.gov/globalarrays/
Other
101 stars 38 forks source link

Comex MPI-PT: nb_wait_for_handle Error #349

Closed edoapra closed 2 months ago

edoapra commented 2 months ago

When using the MPI-PT Comex port, the following error might show up

{0} nb_wait_for_handle Error: all user-level nonblocking handles have been exhausted
{1} nb_wait_for_handle Error: all user-level nonblocking handles have been exhausted

This is due to the fact the value of COMEX_MAX_NB_OUTSTANDING is set to 8 in https://github.com/GlobalArrays/ga/blob/develop/comex/src-mpi-pt/comex_impl.h

Instead, by increasing COMEX_MAX_NB_OUTSTANDING, the error no longer occurs
export COMEX_MAX_NB_OUTSTANDING=12

I will push a pull request for this soon

bjpalmer commented 2 months ago

Hmm. I think I ended up setting this to 256 in MPI-PR (the maximum value). You could probably set it to the same value in MPI-PT. I revamped the NB handles in MPI-PR and MPI3 but a quick and dirty substitution in some of the other runtimes didn't work, so they are still using the old code.

bjpalmer commented 2 months ago

Can we close this issue?

ajaypanyala commented 2 months ago

resolved via #350