search

mila-iqia / blocks

A Theano framework for building and training neural networks
Other
1.16k stars 351 forks source link

Glorot/Bengio initialization #576

Open vikkamath opened 9 years ago

vikkamath commented 9 years ago

I use the so called 'Xavier' initialization in a lot of my work and was wondering if implementing it as a part of blocks.initialization would be of any use.

rizar commented 9 years ago

To make sure we think about the same initialization scheme, could you please give a link to the paper?

vikkamath commented 9 years ago

Understanding the Difficulty of Training Deep Feedforward Networks

rizar commented 9 years ago

Okay, I see. I think it would be nice to have it in Blocks.

vikkamath commented 9 years ago

Okay, thanks! I'll work towards submitting a PR in a few days.