search

axiomizer / haida-go

An implementation of a go (baduk) AI, following methods published for AlphaGo Zero. The primary purpose is to gain hands-on experience with machine learning.
0 stars 0 forks source link

Batch norm for value head #2

Closed axiomizer closed 1 year ago

axiomizer commented 1 year ago

Batch norm is implemented for the convolutional block, the residual block, and the policy head. It needs to be implemented for the value head. Also consider removing biases from layers preceding batch norm.

axiomizer commented 1 year ago

Resolved by commits 6d2ad81eb1a0ba3c35bc83ce53f7c3e2fd789a43 and 612e800eb7d241de742470d13660d934631bc538

axiomizer commented 1 year ago

Need to add a unit test for batch norm

axiomizer commented 1 year ago

We don't need it since it's included in the other tests