anuragmishracse / caption_generator

A modular library built on top of Keras and TensorFlow to generate a caption in natural language for any input image.
MIT License
265 stars 120 forks source link

Awful Captions Generated when Testing #15

Closed crowoy closed 6 years ago

crowoy commented 6 years ago

After finally getting it to work (with basically no changes to the code), and letting it run for 25 epochs, I tried running the test_model.py script. This produces really bad results. I have changed the weights file in the script to use the most recent weights file generated, which was weights-improvement-03.hdf5 for some reason. When training, the accuracy was not increasing, and the loss was increasing.

Here are some of the captions generated when I use that weights file:

Predicting for image: 0
3385593926_d3e9c21170.jpg : A black and white dog jumps in the grass .
Predicting for image: 1
2677656448_6b7e7702af.jpg : A black and white dog is running in the grass .
Predicting for image: 2
311146855_0b65fdb169.jpg : A man wearing a black shirt and blue hair and blue hair and blue hair and blue hair and blue hair and blue hair and blue hair and blue hat and blue shirt and black shirt is people
Predicting for image: 3
1258913059_07c613f7ff.jpg : A man in a black shirt is sitting in a mountain .
Predicting for image: 4
241347760_d44c8d3a01.jpg : A man in a red shirt is playing in the field .
Predicting for image: 5
2654514044_a70a6e2c21.jpg : A black and white dog is running on a field .
Predicting for image: 6
2339106348_2df90aa6a9.jpg : A man wearing a black shirt and blue hair and blue hair and blue hair and blue hair and blue hair and blue hair and blue hair and blue hair and blue hair and white shirt
Predicting for image: 7
256085101_2c2617c5d0.jpg : A black and white dog jumps in the grass .
Predicting for image: 8
280706862_14c30d734a.jpg : A black and white dog running in the snow .
Predicting for image: 9
3072172967_630e9c69d0.jpg : A man in a red shirt is sitting in the background .
Predicting for image: 10
3482062809_3b694322c4.jpg : A man wearing a black shirt and blue hair and blue shorts and blue shorts and blue shorts and blue shirt and blue hair and blue shirt and blue shirt and white shirt and black shirt is people