amazon-connect / ai-powered-speech-analytics-for-amazon-connect

The AI Powered Speech Analytics for Amazon Connect solution provides the combination of speech to text transcription, translation into preferred languages, and insights for agents and supervisors all in real-time
https://aws.amazon.com/solutions/implementations/ai-powered-speech-analytics-for-amazon-connect/
Other
55 stars 54 forks source link

Transcription very slow #10

Closed vidhanbagdai closed 3 years ago

vidhanbagdai commented 4 years ago

There is a delay of almost 6-7 seconds between what I speak and the real time transcription that happens, i.e. the text comes up on screen after 6-7 seconds after I finish speaking. The network speed is almost 100 mbps, still this issue occurs.

tamdilip commented 4 years ago

Yes the transcription latency is high 😐 !!

vidhanbagdai commented 4 years ago

Yes I know! It is impossible to showcase this to potential clients.

vidhanbagdai commented 4 years ago

Does anyone have a sloution for this?

cwwiser commented 4 years ago

Hi, might I suggest tuning your lambdas- I added memory to the real-time lambdas and see fantastic performance in my environment. Also, 100mbps is a measure of bandwidth, not an indication of network latency..

vidhanbagdai commented 4 years ago

@cx-cwiser Tried increasing the memory of lambdas, the transcribed text is coming up quicker on screen but still there is a gap of 5-6 seconds between what the customer speaks and the writing of the transcribed text. Any other suggeestioin or perhaps how much memory to assign to each lambda?

laimonassutkus commented 4 years ago

Its due to the Comprehend/Transcribe service itself. Deal with it. If you want something fast use WEB Speech API.

efh365 commented 4 years ago

You can also try to keep your KVSTranscriber Lambda function warm by following this blog: https://aws.amazon.com/blogs/compute/new-for-aws-lambda-predictable-start-up-times-with-provisioned-concurrency/

You will need to update the KVSTrigger function to call the pre-warmed version of the function

khastation commented 3 years ago

@vidhanbagdai are you still facing this issue?