Closed JakubHolovsky closed 9 months ago
@JakubHolovsky The feature you are asking is not currently supported, speech service side will downmix multi-channel to mono which will be then processed. What kind of user scenario you are working on? Maybe I can help further with more details on the scenario.
@jhakulin in my scenario I have a conversation split between two speakers. Speaker 1 is in LEFT channel, speaker 2 is in RIGHT channel of the stereo .wav file. When I do the continuous transcription, I need to mark each sentence transcribed with the appropriate speaker.
Example:
Speaker 1 is saying "Hello, this is Mark" I expect channel to be set to 0 for that particular sentence as it's coming from the LEFT channel. When speaker 2 says "Hello, this is Adam, thank you for calling" I expect speaker 2 channel to be set to 1 as it's coming from the RIGHT channel.
Is there any workaround to be used if I cannot rely on the channel property?
I saw that I could use the batch processing API but that requires a bit different approach.
@JakubHolovsky For your scenario, we have real-time speaker diarization https://learn.microsoft.com/en-us/azure/ai-services/speech-service/get-started-stt-diarization?tabs=macos&pivots=programming-language-csharp which you can use or batch transcription https://learn.microsoft.com/en-us/azure/ai-services/speech-service/batch-transcription which supports speaker diarization as well. Real-time speaker diarization detects the speakers from mono audio, you can also input multichannel audio in wave PCM format if you like.
Let us know if those would fit to your project and if not what kind of problems you see.
@jhakulin Thank you, I decided to split the wav file into two mono L & R files and process them in parallel and combine the results at the end. That will give me exactly what I am after without many changes. Appreciate your help though.
@jhakulin Thank you, I decided to split the wav file into two mono L & R files and process them in parallel and combine the results at the end. That will give me exactly what I am after without many changes. Appreciate your help though.
Hi @jhakulin , Could you please guide me, how you are merging L & R files in sync?
Describe the bug
When I use continuous speech recognition and observe the result of a property called "SpeechServiceResponse_JsonResult" the channel is always set to 0 even though I am using stereo WAV file - so the audio must be observed from LEFT or RIGHT channel as the speaker position is separated by that.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
A channel should be detected by either 0 (left) or 1 (right) depending on the channel the text was detected from.
Version of the Cognitive Services Speech SDK
1.33.0
Platform, Operating System, and Programming Language