Closed blefaudeux closed 3 years ago
This pull request was exported from Phabricator. Differential Revision: D25383305
This pull request was exported from Phabricator. Differential Revision: D25383305
This pull request was exported from Phabricator. Differential Revision: D25383305
This pull request was exported from Phabricator. Differential Revision: D25383305
This pull request was exported from Phabricator. Differential Revision: D25383305
This pull request was exported from Phabricator. Differential Revision: D25383305
This pull request was exported from Phabricator. Differential Revision: D25383305
This pull request was exported from Phabricator. Differential Revision: D25383305
This pull request was exported from Phabricator. Differential Revision: D25383305
This pull request was exported from Phabricator. Differential Revision: D25383305
Summary: Add Pytorch AMP support. A follow up for FairScale would be to add ShardedGradScaler, so that we support mixed precision with ShardedDDP and ShardedOptimizer
Differential Revision: D25383305