Closed Songyuanwei closed 1 year ago
Thank you for your contribution to the MindCV repo. Before submitting this PR, please make sure:
更新ema,如果梯度溢出时,当不更新loss和梯度的时候,也不进行ema更新。 (Write your motivation for proposed changes here.)
(How should this PR be tested? Do you require special setup to run the test or repro the fixed bug?)
(Is this PR part of a group of changes? Link the other relevant PRs and Issues here. Use https://help.github.com/en/articles/closing-issues-using-keywords for help on GitHub syntax)
Thank you for your contribution to the MindCV repo. Before submitting this PR, please make sure:
Motivation
更新ema,如果梯度溢出时,当不更新loss和梯度的时候,也不进行ema更新。 (Write your motivation for proposed changes here.)
Test Plan
(How should this PR be tested? Do you require special setup to run the test or repro the fixed bug?)
Related Issues and PRs
(Is this PR part of a group of changes? Link the other relevant PRs and Issues here. Use https://help.github.com/en/articles/closing-issues-using-keywords for help on GitHub syntax)