search

soumith / ganhacks

starter from "How to Train a GAN?" at NIPS2016
11.43k stars 1.66k forks source link

Generator try to maximize, Discriminator try to minimize #49

Closed Auth0rM0rgan closed 4 years ago

Auth0rM0rgan commented 5 years ago

Hi, I am training a CycleGAN but the log file(Tensorbaord scalar) for both G and D is confusing to me. As it written in the paper (Also, all the GAN papers), G aims to minimize the objective against an adversary D that tries to maximize it.

At the beginning of training, G is tried to minimize but after 60 epochs start to maximize also D is tried to maximize at the beginning and then start to minimize after epoch 60. I want to know the intuition behind of it. any idea?

should not model to minimize G and maximize D all the time, why after some epochs generators start to maximize and discriminator minimize?

Tensorboard scalar: https://imgur.com/rdTxrUP

Thanks in advance.

adv-ai-tech commented 5 years ago

No Idea