I'm having exploding gradient implementing your WGAN-GP code

znxlwm / pytorch-generative-model-collections

Collection of generative models in Pytorch version.

2.59k stars 546 forks source link

I'm having exploding gradient implementing your WGAN-GP code #7

Open fsalmasri opened 6 years ago

fsalmasri commented 6 years ago

Here is the first two layers gradient in some iteration the gradient is very high and disturb the notwork as you can see in the image below. As far as I know WGAN-GP is to stable the gradient. how could we fix this problem ?
https://imgur.com/a/LHcb3