search

facebookresearch / optimizers

For optimization algorithm research and development.
Other
442 stars 31 forks source link

FSDP Shampoo #12

Closed anana10c closed 1 year ago

anana10c commented 1 year ago

Add prototype implementation of FSDP-compatible Shampoo.

facebook-github-bot commented 1 year ago

@hjmshi has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot commented 1 year ago

@hjmshi has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot commented 1 year ago

@hjmshi has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot commented 1 year ago

@hjmshi merged this pull request in facebookresearch/optimizers@7a8b0fbe85fa76293adb17fb4400bb6fd9376211.