IDSIA / brainstorm

Fast, flexible and fun neural networks.
Other
1.3k stars 154 forks source link

residual_layer #107

Closed jzilly closed 8 years ago

jzilly commented 8 years ago

Created layer proposed in "Deep Residual Learning for Image Recognition" by He et al. which won the ImageNet competition out of curiosity. This layer can be connected in a similar fashion as Highway layers.

Would be interesting to test against highways.

Layer passes all tests (delta, gradient, ...)

Happy holidays everyone!