isi-vista / adam

Abduction to Demonstrate an Articulate Machine
MIT License
11 stars 3 forks source link

Contrastive & Similar Concept Evaluation for Curriculum #1118

Open lichtefeld opened 2 years ago

lichtefeld commented 2 years ago

For upcoming experiments we need to design our curriculum in such a way that we can find interesting contrastive elements between objects and actions. To do so we want to come up with some pair-wise examples for our objects and actions which have interesting contrast. There is a previous document where we did some work on aligning potential objects and actions for overlap (e.g. an object which could participate in a given action) my suggestion is to use this previous document as inspiration when evaluating contrasts.

As a definition, the word 'affordance' is a feature learned from observing an object participate in a given action. For the action 'roll' we can have an affordance for both the 'rollee' and the 'roller' which are unique.

Month 9 Curriculum:

Goal: Identify object pairs which could be confused based on shape or affordances. Outcome: A set of objects which could be confused and a feature which could be discovered contrastively to identify them. (e.g. an 'edible' affordance is a distinction between an apple and a ball)

Month 12 Curriculum:

Goal: A set of 3-5 objects which are similar to at least one object in our curriculum. But is not going to be named.

We'd like to discuss both the contrastive pairings and the similar but unknown objects at our meeting on 4/13.