ranjaykrishna / iq

Information Maximizing Visual Question Generation
https://cs.stanford.edu/people/ranjaykrishna/iq/index.html
Other
66 stars 14 forks source link

The loss got NAN #9

Open zaynmi opened 4 years ago

zaynmi commented 4 years ago

Hello Ranjay, thanks for your work. I have run the train_iq.py using the default lr 0.001, but after 4 epochs, the loss and other metrics got Nan. Is there something wrong with the training script? Looking forward to your reply. Thanks again.

duchengyao commented 4 years ago

the same issue

ozancaglayan commented 3 years ago

Got the same thing in the middle of epoch 2 as well.

mahmudhasankhan commented 1 year ago

Same, after weight decaying starts all the loss got Nan