Multi-rail InfiniBand - Githubissues

microsoft / Microsoft-MPI

Microsoft MPI

MIT License

244 stars 74 forks source link

Multi-rail InfiniBand #34

Open tbiedert opened 4 years ago

tbiedert commented 4 years ago

Does Microsoft MPI support multi-rail on InfiniBand?

On Linux, you can use OpenMPI + UCX.

On a dual Mellanox ConnectX-6 setup, I get the following bandwith benchmark results:

Windows - Microsoft MPI (with zero copy enabled): 11 GB/sec
Linux - OpenMPI/UCX (with UCX_MAX_RNDV_RAILS=4): 48 GB/sec

Thanks!