martinarjovsky / WassersteinGAN

BSD 3-Clause "New" or "Revised" License
3.2k stars 725 forks source link

D Loss did not decrease #46

Open tgong2002 opened 7 years ago

tgong2002 commented 7 years ago

When I trained my WGAN using DCGAN topology on MNIST dataset, I observed that at the very beginning G Loss has decreased to near zero and kept being very small, but D Loss did not decrease even trained after 20000 iterations. What does that mean? Please advice.

=============

Reading other people's comments , it seems that G loss does not have much meaning. But If I removed the training of Generator, just trained on Discriminator.

Iteration 0 complete. Discriminator avg loss: 6.67944732413e-06 Generator avg loss: 0 Iteration 100 complete. Discriminator avg loss: 1082.13891602 Generator avg loss: 0 Iteration 200 complete. Discriminator avg loss: 993.882385254 Generator avg loss: 0 Iteration 300 complete. Discriminator avg loss: 1047.83435059 Generator avg loss: 0 Iteration 400 complete. Discriminator avg loss: 1081.64208984 Generator avg loss: 0 Iteration 500 complete. Discriminator avg loss: 1024.39331055 Generator avg loss: 0 Iteration 600 complete. Discriminator avg loss: 936.895996094 Generator avg loss: 0 Iteration 700 complete. Discriminator avg loss: 1028.81530762 Generator avg loss: 0 Iteration 800 complete. Discriminator avg loss: 1029.08447266 Generator avg loss: 0 Iteration 900 complete. Discriminator avg loss: 1047.0847168 Generator avg loss: 0 Iteration 1000 complete. Discriminator avg loss: 995.261230469 Generator avg loss: 0 Iteration 1100 complete. Discriminator avg loss: 1048.86035156 Generator avg loss: 0 Iteration 1200 complete. Discriminator avg loss: 1040.19873047 Generator avg loss: 0 Iteration 1300 complete. Discriminator avg loss: 1020.10339355 Generator avg loss: 0 Iteration 1400 complete. Discriminator avg loss: 1075.15576172 Generator avg loss: 0

What does this mean?