How can i use this code to train regions & snippets RNN model?

karpathy / neuraltalk

NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.

5.41k stars 1.32k forks source link

How can i use this code to train regions & snippets RNN model? #42

Open lebronze opened 8 years ago

lebronze commented 8 years ago

In this code, i only find how to use images and the images description sentences to train a multimodal RNN. But i don't see any founctions about how to use the regions & snippets to train the model.Just like the figure 5 or part 4.3 in the paper. How can i train my own model? How can i get the result just like the figure 5?

Utsavz commented 8 years ago

@lebronze Did you find out the solution method to the problem? If yes, please answer

lebronze commented 8 years ago

Sorry @Utsavz ,the author of this code said he only provided the generating stage in the paper , but didn't provide the alignment stage. Maybe you can send an email to him for some help.

Utsavz commented 8 years ago

Thank you @lebronze for the help.