search

microsoft / BotBuilder-RealTimeMediaCalling

BotBuilder-RealTimeMediaCalling extends the BotBuilder to enable bots to engage in Skype audio-video calling. It provides real-time, programmable access to the voice, video, and screen sharing streams of a Skype call. The bot is a direct participant in a Skype 1:1 call.
MIT License
77 stars 36 forks source link

Is it possible to use Microsoft translator API ? #40

Open Aakanksha345 opened 6 years ago

Aakanksha345 commented 6 years ago

I am trying to utilize bot to convert the real time audio conversation into translated text of my language. Is it possible to extend the functionality. If yes please inform where do i need to make adjustments in code ?

frleger commented 6 years ago

Hi @Aakanksha345,

Here are a few suggestions. You could use the Microsoft Translator Speech API for speech to text translation: https://docs.microsoft.com/en-us/azure/cognitive-services/translator-speech/overview

You could also use the Azure Speech Service which is in public preview: https://docs.microsoft.com/en-us/azure/cognitive-services/speech-service/overview

In both cases, you would need to feed to the speech/translation APIs the audio received by your bot via the AudioSocket.AudioMediaReceived event handler. You can take a look at the HueBot sample for an example of speech recognition usage.

Thanks Francois