search

ImageMonkey / imagemonkey-core

ImageMonkey is an attempt to create a free, public open source image dataset.
https://imagemonkey.io
47 stars 10 forks source link

suggestion - inter-object labels #36

Open dobkeratops opened 7 years ago

dobkeratops commented 7 years ago

r.e. some of the demonstrated experiments (generating textual descriptions of a scene, not just identifying what is there),

would it make sense to be able to connect object labels, and attach a label to the link . e.g.

"car" ---"towing"---> "trailer" ,  
"person" ---"reloading"---> "gun" 
"person" <--talking-->"person"

.. that sort of thing. could be verbs, or could be prepositions ('behind', 'on', etc). it would add another layer of depth to what your dataset can represent.

(if the triple was itself another linkable object, you could also encode arbitrary sentances )

bbernhard commented 7 years ago

Like that! That's definitely something we could consider when starting with the scene concept.

maybe there is a possibility to gamify that?

dobkeratops commented 7 years ago

"maybe there is a possibility to gamify that?"

it might be more in the realms of a 'pro mode', but even then the validation can still be used ("is this 'a dog looking at a bone' ").

I would hope that greater depth in what you can do with it could help keep interest in the tool.

interesting paper, https://arxiv.org/abs/1502.03044