patil-suraj / vit-vqgan

JAX implementation ViT-VQGAN
MIT License
77 stars 11 forks source link

Add gradient penalty #4

Closed borisdayma closed 2 years ago

borisdayma commented 2 years ago

We need to add a gradient penalty in the GAN discriminator similar to StyleGAN for stability.

Katherine Crowson suggested spectral norm as an alternative and maybe EMA.

borisdayma commented 2 years ago

This is done