-
https://github.com/BaguaSys/bagua-nccl-net/blob/4cb1bc9d62d1c21b3d5e717db2c584f88b8d4744/src/bagua_net.rs#L57-L62
---
###### This issue was generated by [todo](https://todo.jasonet.co) based on a `T…
-
-
-
https://github.com/BaguaSys/bagua/blob/96cb6fe72dfcb2d0394e465291a31aff1f3e0142/bagua/torch_api/distributed.py#L90-L95
---
###### This issue was generated by [todo](https://todo.jasonet.co) based on…
-
## 🐛 Bug
When importing PyTorch Lightning, it throws an `AttributeError: module 'torch.distributed' has no attribute 'ProcessGroup'`. I guess it comes from the fact that I am on macOS (M1) and PyTo…
-
so that users do not need to install cmake, mpi, rustc etc.
-
-
https://github.com/BaguaSys/bagua/blob/cf7b15f45eebb5ee73764fad7669a7ba2c24aca7/bagua/torch_api/algorithms/async_model_average.py#L14-L19
---
###### This issue was generated by [todo](https://todo.j…
-
16*8 V100 VGG16 speedup (100Gb, 25Gb, 10Gb) for
- Bagua gradient allreduce
- Bagua qadam
- Bagua bytegrad
- Bagua decentralized
- Bagua low precision decentralized
- Bagua Async
- PyTorch DDP…
-
- https://buildkite.com/bagua/bagua-gpu-test