techup-group / hopebot

Innovation Summit Metropolitan Ministries hackathon entry.
Apache License 2.0
0 stars 2 forks source link

Bot is not responding correctly in FB, only in Watson UI #43

Closed sxkosone closed 6 years ago

sxkosone commented 6 years ago

Hope bot is not responding correctly to some dialogues in FB Messenger. However Hope is, within the Watson UI, responding correctly to the following dialogue about volunteering:

  1. After detecting that the user wants to volunteer, it asks whether they're looking for individual or group volunteering.
  2. After this, it replies with the respective link to sign up and asks if the user wants more info about different volunteering jobs.
  3. If yes, Hope offers a description of different jobs.

You can see the problem in the screenshot from FB: Hope gets stuck on response number 1. Attached also a screenshot of Watson UI, where the dialogue is working.

nayttokuva 2018-03-26 kello 23 40 16 nayttokuva 2018-03-26 kello 23 39 48

sxkosone commented 6 years ago

Neither the "Can I speak to a human"-dialogue is working, even though it was fine in Watson UI. Hope should respond with a phone number. nayttokuva 2018-03-27 kello 14 09 17

KristenWilde commented 6 years ago

This is an important issue!! On the "Volunteer_Individual" node, I suspect that the intent #Volunteer might be throwing something off. I'm going to experiment with context variables in the Donate section. If we get the hang of that, we can see if it helps with these issues. (Setting "volunteering" as the context of the conversation, and then you don't have to specify #Volunteer within every node.)

KristenWilde commented 6 years ago

Darn, the context variable idea didn't help. I set up the Rent_Assistance and Utility_Assistance dialogues to use context variables. They work great in Watson's console, but not in FB. ☹️

sxkosone commented 6 years ago

I agree @KristenWilde, I think it's something with the intent #volunteer, and then Watson just choosing the first dialogue node that fits that intent. But somehow ONLY in Facebook and even when the child node would be the next logical step, since its reading the nodes top-down.

Also, this hasn't been such a big issue with other nodes. Can it be only connected to dialogues, that have more than 2 steps? Such as donating and volunteering, which both offer several question-answer patterns.

sxkosone commented 6 years ago

"Human please" dialogue working again in Facebook. Only Volunteering and Donating dialogues are giving issues. Donating dialogue offers the "I don't understand what you want to donate" response way too early and often. I think this is due to the complexity of these two dialogues.

KristenWilde commented 6 years ago

Should I go ahead and start re-doing those problem dialogues to make them simpler? I don't want to spend tomorrow doing it, I'd rather attend events during the summit.

sxkosone commented 6 years ago

Rearranging #volunteering nodes fixed the issue for now. Still cannot explain why Watson UI and Facebook Messenger were taking different dialogue paths though. @KristenWilde @miklb