Closed Sergei-Lebedev closed 1 month ago
Disable active set bcast in TL NCCL when lazy communicator init is used
With lazy init we cannot create communicator on first collective since not all ranks participate in init
What
Disable active set bcast in TL NCCL when lazy communicator init is used
Why ?
With lazy init we cannot create communicator on first collective since not all ranks participate in init