search

NVIDIA / nccl

Optimized primitives for collective multi-GPU communication
Other
3.28k stars 829 forks source link

does nccl support cuda graph for scale out scenary #1421

Open yejunguo opened 3 months ago

yejunguo commented 3 months ago

I know that nccl supports cuda graph for scale up case, and how about the scale out case? if yes, is there any example code? thanks.