search

NVIDIA / nccl-tests

NCCL Tests
BSD 3-Clause "New" or "Revised" License
809 stars 229 forks source link

Multi-Node Launch #121

Open apoorvemohan opened 1 year ago

apoorvemohan commented 1 year ago

In many containerized environments (where containers are used to package the runtime and applications), MPI is not available.

Is there a way to launch a multi-node test without MPI?

sjeaugey commented 1 year ago

No, running NCCL tests with multiple processes currently relies on MPI. Wihout MPI, you're bound to a single process, hence a single node.