search

facebookresearch / d2go

D2Go is a toolkit for efficient deep learning
Apache License 2.0
829 stars 197 forks source link

allow setting limit_all_gather in fsdp #598

Closed XiaoliangDai closed 12 months ago

XiaoliangDai commented 1 year ago

Summary: allow setting limit_all_gather in fsdp. This enables faster training, as discussed in S351092

Differential Revision: D47603555

facebook-github-bot commented 1 year ago

This pull request was exported from Phabricator. Differential Revision: D47603555

facebook-github-bot commented 1 year ago

This pull request was exported from Phabricator. Differential Revision: D47603555

facebook-github-bot commented 1 year ago

This pull request was exported from Phabricator. Differential Revision: D47603555

facebook-github-bot commented 1 year ago

This pull request was exported from Phabricator. Differential Revision: D47603555

facebook-github-bot commented 1 year ago

This pull request was exported from Phabricator. Differential Revision: D47603555

facebook-github-bot commented 12 months ago

This pull request was exported from Phabricator. Differential Revision: D47603555

facebook-github-bot commented 12 months ago

This pull request has been merged in facebookresearch/d2go@d8734049203cd450cb45b45515f68023f7164333.