seung-lab / znn-release

Multi-core CPU implementation of deep learning for 2D and 3D sliding window convolutional networks (ConvNets).
GNU General Public License v3.0
94 stars 33 forks source link

NaN in Sparse Training #95

Open william-silversmith opened 8 years ago

william-silversmith commented 8 years ago

When training on labels that may not have any positive classes in the field of view, normalization causes an NaN to propagate through the network. Would it be possible to add an epsilon to the denominator to prevent this gift that keeps on giving?

Sachin and Nick get around this (amongst other reasons) by limiting their samples to those containing a positive class.