axiomizer / haida-go

An implementation of a go (baduk) AI, following methods published for AlphaGo Zero. The primary purpose is to gain hands-on experience with machine learning.
0 stars 0 forks source link

Running averages for batch norm #4

Closed axiomizer closed 1 year ago

axiomizer commented 1 year ago

The class src.nn.batch_norm.BatchNorm should probably keep running averages, the same way that torch.nn.BatchNorm2D does.

Docs for BatchNorm2D

I think this will need a unit test.

axiomizer commented 1 year ago

Implemented in 082c3f6a00a5ee6cd107c092a757e408d4cdecc2

axiomizer commented 1 year ago

Unit test added in 000726f4da252441f75903308d509dcd935e1fea