graphcore-research / unit-scaling

A library for unit scaling in PyTorch
https://graphcore-research.github.io/unit-scaling/
Apache License 2.0
104 stars 7 forks source link

Changes grad_w default scaling to be 0.75 #31

Closed thecharlieblake closed 1 year ago