Closed axiomizer closed 1 year ago
The class src.nn.batch_norm.BatchNorm should probably keep running averages, the same way that torch.nn.BatchNorm2D does.
Docs for BatchNorm2D
I think this will need a unit test.
Implemented in 082c3f6a00a5ee6cd107c092a757e408d4cdecc2
Unit test added in 000726f4da252441f75903308d509dcd935e1fea
The class src.nn.batch_norm.BatchNorm should probably keep running averages, the same way that torch.nn.BatchNorm2D does.
Docs for BatchNorm2D
I think this will need a unit test.