BatchNorm is not pure - Githubissues

facebookresearch / diffkt

A framework for automatic differentiation in Kotlin

MIT License

60 stars 6 forks source link

BatchNorm is not pure #14

Open gafter opened 3 years ago

gafter commented 3 years ago

The current shape of the BatchNorm layer is not pure - it has some internal state used to compute a rolling average. It would be nice to refactor the APIs so that it is pure.