search

FoundationVision / LlamaGen

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation
https://arxiv.org/abs/2406.06525
MIT License
1.34k stars 55 forks source link

Questions about the discriminator #35

Closed Doctor-James closed 4 months ago

Doctor-James commented 5 months ago

Follow issue https://github.com/FoundationVision/LlamaGen/issues/27 I would like to ask if the discriminator's logit_real and logit_fake are always similar, and when they are both positive, the discriminator_adv_loss will be negative. Is such a discriminator beneficial to the generator?

PeizeSun commented 5 months ago

Hi~ I understand this is magic. The adversarial process can’t be dominated by either generator or discriminator. Also, I highly recommend to run other GAN codebases to see this magic phenomena.