openai / openai-realtime-console

React app for inspecting, building and debugging with the Realtime API
MIT License
1.79k stars 593 forks source link

audio stops randomly while speaking #33

Open polyrenn opened 2 weeks ago

polyrenn commented 2 weeks ago

in vad mode, sometimes the audio cuts out mid way, it doesn't finish it's speech, I've tried tracing where it could be coming from but got no clue

khorwood-openai commented 2 weeks ago

I believe this may be a glitch with the model; hang tight while in beta. We're working to get to these. :)

khorwood-openai commented 1 week ago

Re-opening for visibility.

Stevenic commented 1 week ago

+1

I've seen this too... It's like it drops the last packet of audio sometimes.

melonkernel commented 1 week ago

I experience the same. I tested it both with a newly checked out repo and with the one i checked out last week (It did not have this issue during the weekend) On both versions this happens.

dannybess1 commented 1 week ago

+1 seeing this as well w/ certain prompts. Hard to repro consistently, but the last ~200-300ms of audio seem to get clipped

needsmorejpeg commented 2 days ago

Hi @khorwood-openai, does the team have any updates or ETA for a fix?

I've been experiencing this issue as well, across several platforms (LiveKit, Twilio, and the OpenAI playground). I'm excited to be using the new API, but I think the audio cutoffs make it challenging to build a reliable user experience in third party applications.

Would appreciate any extra details you can share 🙏🫡