NCCL_Algo=Tree - Githubissues

NVIDIA / nccl-tests

NCCL Tests

BSD 3-Clause "New" or "Revised" License

819 stars 230 forks source link

Open afattaholman opened 1 month ago

afattaholman commented 1 month ago

Hi, I was wondering if it makes sense to set the NCCL_Algo=Tree while performing the all2all test? Thanks,

AddyLaddy commented 1 month ago

NCCL_ALGO has no effect on A2A (P2P operations). NCCL does not have an A2A collective API either, it's implemented with P2P Send/Recv calls.