WGAN_GP - tensorflow

[Naxter]

Hey, I appreciate your work! You make my life better.

I found (maybe) a small bug in your WGAN_GP code. When calculating gradient penalty, you write:

D_inter,_,_=self.discriminator(interpolates, is_training=True, reuse=True) 
gradients = tf.gradients(D_inter, [interpolates])[0]

You use the sigmoid output of the Discriminator, not the logits.

In the original implementation (https://github.com/igul222/improved_wgan_training/blob/master/gan_mnist.py), they write this:

gradients = tf.gradients(Discriminator(interpolates), [interpolates])[0]

Here, the authors only return the logits of the Discriminator. So they use the logits for this calculation.

Did you do this on purpose?

Greetings!

[hwalsuklee]

Hi. I'm really appreciate for your comment.

You are right. I made mistakes in using output of the Discriminator. It must be logits of the Discriminator.

I fixed codes.

Thanks again.