Over long term connections STT service (soniox) delays up to 20-30 seconds, is it the same with deepgram?

[beastoin]

Bro @josancamon19 feel free to note your experiences / your findings 😌

[josancamon19]

Findings so far:

Soniox (No VAD)

• Starts short with a few (5 ish) seconds, but with constant transcription, or after a lot of no voice, it delays 15-20.

Soniox (VAD)

• I feel like on long conversations it takes less time, like 10 seconds each, it feels faster sometimes than No VAD, as probably soniox model overloads less, or maybe even the network

~~ What's the problem with VAD here then?

1. soniox closes the connection after sometimes without receiving bytes thus causing reconnecting states (should be fixed with ping every 10 seconds already)
2. small words, or short sentences from (empty -> 5 words -> empty) sometimes do not get detected, the model is not good when switching conditions very fast I think. Do not appear or get super delayed (30-60 secs).
3. last few words after a long conversation can delay very badly (30-60 secs too).

[josancamon19]

Deepgram is instant! after 100ms utterance, is almost instant, all the time.

with VAD doesn't really make a difference, makes it 3 seconds delay, max 5.

The only part annoying, is when switching sockets, a couple seconds might be lost at that point.

Short words burst, take 5-8 secs, but then becomes instant again.

[josancamon19]

Concerns about Deepgram:

1. Lower transcript quality than soniox : /
2. Non native speech profile identification limits future use, and is not better than soniox native person recognition.

Concerns about Soniox:

1. Initially thought it was faster than deepgram, but after a long time the socket connected, it delays more.
2. Delay with VAD, on short words, or after a long period of silence, is 6-10 times worst than deepgram.

[beastoin]

great finding!

[beastoin]

[beastoin]

what if the soniox also need some words to keep the connection, the keepalive will not help :?

[beastoin]

Sent an email to Soniox Team about the finding 15-20s delays after a long lived session.

[beastoin]

just leave a check, smooth for me now, maybe get back in the future .