The difference between algbw and busbw

NVIDIA / nccl-tests

NCCL Tests

BSD 3-Clause "New" or "Revised" License

809 stars 229 forks source link

The difference between algbw and busbw #159

Open allinsds opened 1 year ago

allinsds commented 1 year ago

I can not understand the difference between algbw and busbw, in nccl-tests result. when n > 2 (the number of rank more than two) , busbw > algbw, Can you explain in detail with an example?