Language Test: Scenarios with BrainResponder

[BramKraai]

Hey,

I manually tested the language test scenarios in a live application: worked through them all and looked if they were working. All entries with a tick box are working! For every entry that is not working 100%, the log is provided. Hope this is useful for debugging :)

These tests were done on the latest Develop branch!

Here we go:

• [x] you are a robot

• [x] are you a robot

• [x] who is a robot

• [ ] who is the robot (Google picked this up, resulting in no answer, which might be okay, actually)

  10/16/19 13:25:16 INFO     pepper.Chat (Bram)              006       Bram: "who is the robot"
  10/16/19 13:25:16 DEBUG    pepper.pepper.language.analyzer     initial RDF: {'predicate': u'is', 'object': u'the-robot', 'subject': ''}
  10/16/19 13:25:16 DEBUG    pepper.pepper.language.analyzer     after VP: {'predicate': u'be', 'object': u'the-robot', 'subject': ''}
  10/16/19 13:25:16 DEBUG    pepper.pepper.language.analyzer     after NP: {'predicate': u'be', 'object': u'the-robot', 'subject': ''}
  10/16/19 13:25:16 DEBUG    pepper.pepper.language.analyzer     final RDF: {'predicate': {'text': u'be', 'type': u'verb.stative'}, 'object': {'text': u'the-robot', 'type': [u'noun.artifact']}, 'subject': {'text': '', 'type': []}} {'neg': False, 'wh_word': {u'response': u'person'}}
  10/16/19 13:25:16 INFO     pepper.pepper.language.analyzer     RDF    subject: {"text": "", "type": []}
  10/16/19 13:25:16 INFO     pepper.pepper.language.analyzer     RDF  predicate: {"text": "be", "type": "verb.stative"}
  10/16/19 13:25:16 INFO     pepper.pepper.language.analyzer     RDF     object: {"text": "the-robot", "type": ["noun.artifact"]}
  10/16/19 13:25:16 DEBUG    pepper.RdfBuilder                   Booted
  10/16/19 13:25:17 DEBUG    pepper.BrainResponder               TRIPLE: ?_be_the-robot [_->_artifact or object])
  10/16/19 13:25:17 INFO     pepper.LongTermMemory               Triple: ?_be_the-robot [_->_artifact or object])
  10/16/19 13:25:17 DEBUG    pepper.LongTermMemory               Posting query
  10/16/19 13:25:17 DEBUG    pepper.BrainResponder               REPLY: I know things usually be artifact, but I do not know this case
  10/16/19 13:25:17 INFO     pepper.ResponsePicker               BrainResponder (0.18s)
  10/16/19 13:25:17 INFO     pepper.Chat (Bram)              007    Leolani: "I know things usually be artifact, but I do not know this case"

• [x] you live in Amsterdam

  
  works, but does not form a reply, resulting in another responder to be called.

10/16/19 13:26:06 INFO pepper.Chat (Bram) 014 Bram: "you live in Amsterdam" 10/16/19 13:26:06 DEBUG pepper.pepper.language.analyzer initial RDF: {'predicate': u'live', 'object': u'in-Amsterdam', 'subject': u'you'} 10/16/19 13:26:06 DEBUG pepper.pepper.language.analyzer after VP: {'predicate': u'live', 'object': u'in-Amsterdam', 'subject': u'you'} 10/16/19 13:26:06 DEBUG pepper.pepper.language.analyzer after NP: {'predicate': u'live', 'object': u'in-Amsterdam', 'subject': u'leolani'} 10/16/19 13:26:06 DEBUG pepper.pepper.language.analyzer final RDF: {'predicate': {'text': u'live-in', 'type': [u'verb.stative', 'preposition']}, 'object': {'text': u'Amsterdam', 'type': u'noun.location'}, 'subject': {'text': u'leolani', 'type': ['robot']}} {'neg': False} 10/16/19 13:26:06 INFO pepper.pepper.language.analyzer RDF subject: {"text": "leolani", "type": ["robot"]} 10/16/19 13:26:06 INFO pepper.pepper.language.analyzer RDF predicate: {"text": "live-in", "type": ["verb.stative", "preposition"]} 10/16/19 13:26:06 INFO pepper.pepper.language.analyzer RDF object: {"text": "Amsterdam", "type": "noun.location"} 10/16/19 13:26:06 DEBUG pepper.RdfBuilder Booted 10/16/19 13:26:06 DEBUG pepper.BrainResponder TRIPLE: leolani_live-inamsterdam [robot->_location]) 10/16/19 13:26:06 DEBUG pepper.LocationReasoner Posting query 10/16/19 13:26:06 INFO pepper.LongTermMemory Triple: leolani_live-inamsterdam [robot->_location]) 10/16/19 13:26:06 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:26:06 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:26:06 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:26:06 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:26:06 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:26:07 INFO pepper.LongTermMemory Posting triples 10/16/19 13:26:07 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:26:07 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:26:07 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:26:07 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:26:07 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:26:07 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:26:07 DEBUG pepper.LongTermMemory Posting query 10/16/19 13:26:07 DEBUG pepper.BrainResponder REPLY: 10/16/19 13:26:07 INFO pepper.ResponsePicker GreetingResponder (0.00s) 10/16/19 13:26:07 INFO pepper.Chat (Bram) 015 Leolani: "What's new?, Bram!"

- [x] who lives in Amsterdam
- [x] do you live in Amsterdam

- [x] I am a man

again: works, but does not form a reply, resulting in another responder to be called.

10/16/19 13:27:01 INFO pepper.Chat (Bram) 024 Bram: "I am a man" 10/16/19 13:27:01 DEBUG pepper.pepper.language.analyzer initial RDF: {'predicate': u'am', 'object': u'a-man', 'subject': u'I'} 10/16/19 13:27:01 DEBUG pepper.pepper.language.analyzer after VP: {'predicate': u'be', 'object': u'a-man', 'subject': u'I'} 10/16/19 13:27:01 DEBUG pepper.pepper.language.analyzer after NP: {'predicate': u'be', 'object': u'a-man', 'subject': 'Bram'} 10/16/19 13:27:01 DEBUG pepper.pepper.language.analyzer final RDF: {'predicate': {'text': u'be', 'type': u'verb.stative'}, 'object': {'text': u'a-man', 'type': [u'noun.person']}, 'subject': {'text': 'Bram', 'type': ['person']}} {'neg': False} 10/16/19 13:27:01 INFO pepper.pepper.language.analyzer RDF subject: {"text": "Bram", "type": ["person"]} 10/16/19 13:27:01 INFO pepper.pepper.language.analyzer RDF predicate: {"text": "be", "type": "verb.stative"} 10/16/19 13:27:01 INFO pepper.pepper.language.analyzer RDF object: {"text": "a-man", "type": ["noun.person"]} 10/16/19 13:27:01 DEBUG pepper.RdfBuilder Booted 10/16/19 13:27:01 DEBUG pepper.BrainResponder TRIPLE: bram_bea-man [person->_person]) 10/16/19 13:27:01 DEBUG pepper.LocationReasoner Posting query 10/16/19 13:27:01 INFO pepper.LongTermMemory Triple: bram_bea-man [person->_person]) 10/16/19 13:27:01 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:27:01 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:27:01 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:27:01 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:27:01 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:27:02 INFO pepper.LongTermMemory Posting triples 10/16/19 13:27:02 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:27:02 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:27:02 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:27:02 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:27:02 DEBUG pepper.ThoughtGenerator Posting query 10/16/19 13:27:02 DEBUG pepper.LongTermMemory Posting query 10/16/19 13:27:02 DEBUG pepper.BrainResponder REPLY: 10/16/19 13:27:02 INFO pepper.ResponsePicker UnknownResponder (0.00s) 10/16/19 13:27:02 INFO pepper.Chat (Bram) 025 Leolani: "Why?"

- [x] who is a man

- [x] I like baking cakes
- [x] what do I like
- [x] do I like baking cakes
- [x] who likes baking cakes - you told me you like baking cakes

- [ ] Birds can sing

The

[BramKraai]

These come from test/language/data/statements.txt and they all work!

• [x] lana can read a book: lana can-read a-book
• [x] lana must read: lana must-read
• [x] john will come to Amsterdam: john will-come-to Amsterdam
• [x] you have been in paris: leolani have-been-in paris
• [x] animals must drink water: animals must-drink water
• [x] food should be healthy: food should-be healthy
• [x] lana is reading a book: lana read a-book
• [x] you are going to England: leolani go-to england
• [x] you like talking to people: leolani like talking-to-people
• [x] john enjoys watching movies: john enjoy watching-movies
• [x] lana read a book: lana read a-book
• [x] I live in the Netherlands: lenka live-in the-netherlands
• [x] you live in this office: leolani live-in this-office
• [x] you are a robot: leolani be a-robot
• [x] I am a person: lenka be a-person
• [x] humans can eat food: humans can-eat food
• [x] swimming is a sport: swimming be a-sport
• [x] bram loves sport: bram love sport

  Google just won't accept bram loves sport and makes Bram love Sport from it. Annoying...

• [x] you come from france: leolani come-from france

NOTE: In more than 50% of the cases there is no reply, resulting in the UnknownResponder to be triggered (since there is no other responder that can deal with these sentences). So she will say something in the vein of: "I have no clue what you're talking about", while the sentence was accurately parsed, the triple nicely made and the brain correctly updated.