facebookresearch / fairscale

PyTorch extensions for high performance and large scale training.
Other
3.18k stars 280 forks source link

Assign self.norm_type to input norm_type #1157

Closed gtamer2 closed 9 months ago

gtamer2 commented 10 months ago

What does this PR do?

Fixes #1156

Before submitting

PR review

TBD

brad-mengchi commented 9 months ago

Oh just saw your PR. Maybe let me approve and merge it. @gtamer2