search

nashory / progressive-growing-torch

Torch implementation of "PROGRESSIVE GROWING OF GANS FOR IMPROVED QUALITY, STABILITY, AND VARIATION"
MIT License
36 stars 8 forks source link

Weight normalization layer #2

Open nashory opened 6 years ago

nashory commented 6 years ago

(https://github.com/torch/nn/blob/master/WeightNorm.lua)

nashory commented 6 years ago

normalize the weights of the previous layer dynamically. need to be implemented.

nashory commented 6 years ago

Can I use simply use torch nn.WeightNorm for equalized learning rate in the paper??

nashory commented 6 years ago

https://github.com/stormraiser/GAN-weight-norm/tree/master/torch/modules

nashory commented 6 years ago

tested torch nn.WeightNorm, but it seems to harm training.

nashory commented 6 years ago

I found (https://github.com/stormraiser/GAN-weight-norm) maybe we can use this.