how to implement the weightnorm in Caffe

openai / weightnorm

Example code for Weight Normalization, from "Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks"

https://arxiv.org/abs/1602.07868

MIT License

365 stars 118 forks source link

how to implement the weightnorm in Caffe #9

Open PkuRainBow opened 7 years ago

PkuRainBow commented 7 years ago

hi,

I am doing some topic in deep metric learning and I have some proof the normalization for the fully connected layer can help us. But I am wondering whether you could offer the weight normalization implementation with caffe ?

Thanks yuhui