peteanderson80 / SPICE

Semantic Propositional Image Caption Evaluation
http://panderson.me/spice
GNU Affero General Public License v3.0
136 stars 31 forks source link

Would it be possible to evaluate scene graph from visual genome dataset #7

Open xiaofeiwu opened 5 years ago

xiaofeiwu commented 5 years ago

Hi Peter,

Thanks for the great work. I wonder would it be possible to evaluate scene graph from visual genome dataset. Is there a demo?

peteanderson80 commented 5 years ago

Yes it would be possible. There is no demo because I haven't ever tried it. I'd be really interested to see how it works. You would need to modify the code somewhat. Basically, instead of loading the reference scene graphs by parsing the reference captions, you would need to implement another method to load reference scene graphs from the VG annotations.