search

karpathy / neuraltalk

NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.
5.4k stars 1.32k forks source link

MRFs for text segment alignments #12

Closed pradeepkaruturi closed 9 years ago

pradeepkaruturi commented 9 years ago

Hi Andrej, Thank you very much for open sourcing the code! You paper talks about MRFs for decoding text segment alignments to images, but I couldn't find any code related to that. Am I missing something?

Thanks Pradeep.

sxjzwq commented 9 years ago

Me too. It seems that there is no code for that part. @karpathy , do you have any plan to publish the code of that part (text segment alignment using MRF).

Thanks. Qi

karpathy commented 9 years ago

Hi, there are two models in my paper: an alignment/retrieval model and a generation model. I released the generation model. The retrieval model does ranking (image -> sentence or vice versa), and includes computing the alignments, etc. This part was not released.