search

open-mpi / ompi

Open MPI main development repository
https://www.open-mpi.org
Other
2.13k stars 857 forks source link

Heterogeneous Multi-port OpenIB fails various IMB tests #13

Closed ompiteam closed 3 years ago

ompiteam commented 9 years ago

Between PPC64 and X86-64 using two ports of Open IB we fail a number of IMB benchmarks. This does not occur on the 1.2 branch with heterogeneous patches. 


#----------------------------------------------------------------
# Benchmarking Allreduce 
# #processes = 2 
# ( 2 additional processes waiting in MPI_Barrier)
#----------------------------------------------------------------
       #bytes #repetitions  t_min[usec]  t_max[usec]  t_avg[usec]
            0         1000         0.07         0.17         0.12
            4         1000        17.23        17.24        17.24
            8         1000        18.78        18.79        18.78
           16         1000        19.19        19.21        19.20
           32         1000        21.32        21.34        21.33
           64         1000        25.07        25.09        25.08
          128         1000        34.13        34.15        34.14
          256         1000        49.14        49.17        49.15
          512         1000        71.47        71.52        71.50
         1024         1000       122.10       122.17       122.14
         2048         1000       219.91       220.04       219.97
         4096         1000       417.00       417.24       417.12
m in the input buffer 2 bytes
unpack there is still room in the input buffer 2 bytes
unpack there is still room in the input buffer 2 bytes
unpack there is still room in the input buffer 2 bytes
unpack there is still room in the input buffer 2 bytes
ompiteam commented 9 years ago

Imported from trac issue 790. Created by gshipman on 2007-01-17T21:21:18, last modified: 2008-06-23T15:12:54

ompiteam commented 9 years ago

Trac comment by jsquyres on 2007-01-18 06:48:06:

Can you try with just the "basic" coll? There have been a number of changes to the tuned coll on the trunk that have not propagated over to the 1.2 branch.

ompiteam commented 9 years ago

Trac comment by jsquyres on 2008-06-23 15:12:54:

This ticket is ancient -- do we know if it's still a problem?

Brad -- can you test it in an heterogeneous environment?

gpaulsen commented 3 years ago

In current release branches v4.0.x, v4.1.x, the datatype engine has been reimplemented relative to this old issue. Open-ib no longer exists in the v5.0.x branch. We should retest IMB using two ports of openib on a v4.0.x.