search

NifTK / NiftyNet

[unmaintained] An open-source convolutional neural networks platform for research in medical image analysis and image-guided therapy
http://niftynet.io
Apache License 2.0
1.36k stars 404 forks source link

Implement FixUp Layer #460

Open danieltudosiu opened 4 years ago

danieltudosiu commented 4 years ago

Implementing FixUp initialization [1] based convolutional layer as it allows one to train without normalization.

[1] Zhang, Hongyi, Yann N. Dauphin, and Tengyu Ma. "Fixup initialization: Residual learning without normalization." arXiv preprint arXiv:1901.09321 (2019).