SEPIA-Framework / sepia-docs

Documentation and Wiki for SEPIA. Please post your questions and bug-reports here in the issues section! Thank you :-)
https://sepia-framework.github.io/
238 stars 16 forks source link

Does Sepia have the ability to understand domain specific knowledge? #133

Open gabrielcolon32 opened 3 years ago

gabrielcolon32 commented 3 years ago

Hi! Does Sepia have the ability to understand domain specific knowledge and commands? More specifically: could you train Leon and optimize it to only understand commands related to let's say, setting up a timer or ordering a pizza?

fquirin commented 3 years ago

Hi, SEPIA's NLU chain is modular. You could deactivate the rules-based part that controls most of the integrated services and replace it with your own NLU (e.g. with the python-bridge), write your own lists of static commands or partially deactivate services. Besides that I'm currently experimenting with domain-specific voice-widgets that you can activate with a specific command (e.g. "start medi bot") and then redirect all input into one specific service. In theory each voice-widget could also use it's own speech-recognition model. Its a bit like an Alexa app that you can switch on and off.