google / objax

Apache License 2.0
769 stars 77 forks source link

Improve BatchNorm numerical stability #182

Closed david-berthelot closed 3 years ago

david-berthelot commented 3 years ago

Instead of computing variance as E[x^2] - E[x]^2, use E[(x - E[x])^2]