search

abhiskk / ladder

Implementation of Ladder Network in PyTorch.
GNU General Public License v3.0
45 stars 15 forks source link

Normalization variance calculation backprop #2

Open abhiskk opened 7 years ago

abhiskk commented 7 years ago

While calculating variance for the modified batch normalization the variance which is calculated is done after getting detached from the backprop which breaks the backprop.