BaguaSys / bagua

Bagua Speeds up PyTorch
https://tutorials-8ro.pages.dev/
MIT License
875 stars 83 forks source link

fix FusedOptimizer #61

Closed NOBLES5E closed 3 years ago

NOBLES5E commented 3 years ago

We need to solve the optimizer OOM when param storage changed

create-issue-branch[bot] commented 3 years ago

Branch issue-61-fix_FusedOptimizer created!

wangraying commented 3 years ago

solved this problem in https://github.com/BaguaSys/bagua/pull/207 and https://github.com/BaguaSys/bagua/pull/356