Open simonschwaer opened 9 months ago
Previously, small values were clamped inside a torch.sqrt, so that the smallest possible values were sqrt(eps) instead of eps. For example, the default eps=1e-8 led to a smallest value of 1e-4.
torch.sqrt
sqrt(eps)
eps
eps=1e-8
1e-4
Previously, small values were clamped inside a
torch.sqrt
, so that the smallest possible values weresqrt(eps)
instead ofeps
. For example, the defaulteps=1e-8
led to a smallest value of1e-4
.