Add support for remote stt service and local tts

MycroftAI / mycroft-gui

The Graphical User Interface used by the Mycroft Mark II and more

Apache License 2.0

167 stars 57 forks source link

Add support for remote stt service and local tts #31

Closed AIIX closed 5 years ago

AIIX commented 5 years ago

Adds support for sending raw audio from PCM to a mycroft-core instance located on a remote server via the messagebus socket.

Currently timer based approach for recording and sending raw audio
Added as gui app setting to be optionally available

AIIX commented 5 years ago

Added support for cmake build option BUILD_LOCAL_TTS
If enabled uses Qtexttospeech and speech dispatcher for TTS output

notmart commented 5 years ago

just some minor issues. in the short term is ok. in the long term, i wonder if mycroft-core could be modified/configured to send its actual utterance sound file on the main socket, so we can just playback that?

AIIX commented 5 years ago

just some minor issues. in the short term is ok. in the long term, i wonder if mycroft-core could be modified/configured to send its actual utterance sound file on the main socket, so we can just playback that?

Haven't looked into what mimic/mimic-2 is sending the mycroft-audio client yet if it is retrievable as raw audio frames can try streaming it back on the socket and playing the audio in GUI, will look into it.

AIIX commented 5 years ago

Removed the previous qtexttospeech implementation and added option to stream the sound file produced via mimic from the main socket. This also removes the cmake option of BUILD_LOCAL_TTS and can be activated from a switch in GUI app.

AIIX commented 5 years ago

Moved RemoteTTS and RemoteSTT under build flag "BUILD_REMOTE_TTS" and fixed previous coding style things