jazzsaxmafia / show_and_tell.tensorflow

BSD 2-Clause "Simplified" License
291 stars 92 forks source link

Learning Cost is become stagnant after 300 iteration (epoch) #8

Open dipanjan06 opened 8 years ago

dipanjan06 commented 8 years ago

Hello,

First of all thank you for publishing this great code base. I have trained model upto 300 epoch but it looks like the learning cost is not reduced much and stayed around 1.5 to 1.6 . Did you land up this kind of situation . I am running this code on my laptop which has NVIDIA GPU (920m ) and took long time to complete a single epoch ( 100 epoch took near about 40 hours) . Need your suggestion whether should I continue learning until 1000 epoch or any trick would required to process further iteration . Please note that after 300 iteration model is still not able generate proper caption from any random image( Facebook, Instagram etc) . I believe this error should reduced further to get a proper model.

Thanks in advance.

Regards, Dipanjan