jasperzhong / cs-notes

CS认知体系
6 stars 0 forks source link

learn NCCL #20

Open jasperzhong opened 2 years ago

jasperzhong commented 2 years ago

https://docs.nvidia.com/deeplearning/nccl/user-guide/docs/index.html

jasperzhong commented 2 years ago

NCCL初体验 :thinking:

Example 2: One Device per Process or Thread

https://docs.nvidia.com/deeplearning/nccl/user-guide/docs/examples.html

image