-
**Describe the bug**
A clear and concise description of what the bug is.
backbone = backbone.with_bagua([optimizer], algorithm)
if rank == 0:
os.makedirs(backbone_pat…
-
https://github.com/BaguaSys/bagua/pull/228/files#diff-a5d7ee32ab8d93a59290923aeb9597cae5becc8fb682daeac373c91bce6061f3R96-R98
-
**Describe the bug**
A clear and concise description of what the bug is.
![image](https://user-images.githubusercontent.com/78945582/139172923-cc1c9b0c-63c1-4fbd-b7a2-7bc4f6559263.png)
**Environm…
-
We need to solve the optimizer OOM when param storage changed
-
refer to: https://pytorch.org/docs/stable/_modules/torch/nn/parallel/distributed.html#DistributedDataParallel.no_sync
-
-
**Describe the bug**
A clear and concise description of what the bug is.
**Environment**
- Your operating system and version:Ubuntu18.04
- Your python version:3.8
- Your PyTorch version:11…
-
-
Hello, when I use "pip3 install bagua" to install bagua, it failed to build bagua-core, but I have installed "cmake" and it can be used normally.
Could you help to give some suggestions? Thank you
…
-