NCCL_Algo=Tree - Githubissues

NVIDIA / nccl-tests

NCCL Tests

BSD 3-Clause "New" or "Revised" License

894 stars 240 forks source link

Open afattaholman opened 3 months ago

afattaholman commented 3 months ago

Hi, I was wondering if it makes sense to set the NCCL_Algo=Tree while performing the all2all test? Thanks,

AddyLaddy commented 3 months ago

NCCL_ALGO has no effect on A2A (P2P operations). NCCL does not have an A2A collective API either, it's implemented with P2P Send/Recv calls.