search

RasaHQ / rasa

💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
https://rasa.com/docs/rasa/
Apache License 2.0
18.6k stars 4.6k forks source link

Add confidence level to entities and intent #64

Closed guillegette closed 7 years ago

guillegette commented 7 years ago

Would be great to return the confidence for an intent and/or entity, how does it work at the moment? does it return the best match ? Happy to help implementing this as well :)

nmstoker commented 7 years ago

This would be useful, because it could enable handling of fallback intents, which API.AI has but I assume aren't included/possible in Rasa as it is currently (is that right?)

amn41 commented 7 years ago

Yes that's right. What does work is to train a generic intent like none or outofscope. I could see how a confidence value would be really nice to have though.

designerkamal commented 7 years ago

@amn41 Any thoughts on how to train a good none intent, like the one that comes with Luis.

amn41 commented 7 years ago

@designerkamal In my experience it works quite well to just have a bunch of "out of scope" sentences labelled as None. This seems to generalise quite well. If you are having trouble please feel free to email me and I will think of ways you can improve perf :)

guillegette commented 7 years ago

awesome!!

ruchambapat commented 7 years ago

what is the logic behind deciding the confidence value? Is there any threshold? I want to know this for designing my chatbot