search

soumith / ganhacks

starter from "How to Train a GAN?" at NIPS2016
11.46k stars 1.66k forks source link

Adam in the generator? #20

Open JasonGUTU opened 7 years ago

JasonGUTU commented 7 years ago

There is a little problem with the using of the adam optimizer in generator. From my experience, the using of optimizer with momentum may cause instability in training. Actually, I think the RMSprop is a better choice. This is my personal view and experience, discussion is welcomed.

rafaelvalle commented 7 years ago

@JasonGUTU What data, GAN objetive function and model architecture are you using?

stormraiser commented 7 years ago

Agreed. Using plain GAN on CelebA.