search

wiseodd / generative-models

Collection of generative models, e.g. GAN, VAE in Pytorch and Tensorflow.
http://wiseodd.github.io
The Unlicense
7.3k stars 2.04k forks source link

Should there be leakyrelu layers for discriminator in the wgan-gp? #42

Closed tldoan closed 6 years ago

tldoan commented 6 years ago

I saw that on the official github for that paper https://github.com/igul222/improved_wgan_training/blob/master/gan_mnist.py#L86

does it make some difference ?

wiseodd commented 6 years ago

It's stated in the paper: it doesn't matter. But they said that ELU didn't work.