search

NVIDIA / nccl

Optimized primitives for collective multi-GPU communication
Other
3.28k stars 829 forks source link

How to switch between run_tree_up_down and run_tree_split algorithm #1336

Closed ZhiyiHu1999 closed 5 months ago

ZhiyiHu1999 commented 5 months ago

Hello! Is there a setting that we can change like NCCL_ALGO or NCCL_PROTO environmental variable so that we can switch between run_tree_up_down and run_tree_split algorithm when we use tree algorithm. Thanks a lot!