Open 3outeille opened 9 months ago
Check out this pull request on
See visual diffs & provide feedback on Jupyter Notebooks.
Powered by ReviewNB
Found out fairscale has the same bug as us => https://github.com/xrsrke/megatron-tp . Issue is put on hold