search

BaguaSys / bagua

Bagua Speeds up PyTorch
https://tutorials-8ro.pages.dev/
MIT License
872 stars 83 forks source link

support NCCL 2.10 and ncclAvg operation #139

Closed NOBLES5E closed 3 years ago

NOBLES5E commented 3 years ago

See https://docs.nvidia.com/deeplearning/nccl/user-guide/docs/api/types.html#c.ncclAvg

NOBLES5E commented 3 years ago

Done in https://github.com/BaguaSys/bagua/commit/87d93c65aec22ab45e16d04554843105990b4d9f, https://github.com/BaguaSys/bagua-core/commit/370ea2a96f55796d697fad723610ec41ea28e164