search

openai / openai-realtime-console

React app for inspecting, building and debugging with the Realtime API
MIT License
739 stars 135 forks source link

Connecting AudioNodes from AudioContexts with different sample-rate is currently not supported. #5

Open DuckyBlender opened 1 day ago

DuckyBlender commented 1 day ago

image

DuckyBlender commented 1 day ago

only occurs on firefox

mmtmn commented 1 day ago

I've experienced the same issue, exploring to see if there is a simple fix that won't take too much time

mmtmn commented 1 day ago

Ok, I think I fixed it, creating a pull request for firefox

mmtmn commented 1 day ago

This pull request should fix it, but let's wait for it to get reviewed by OpenAI staff

Grant-CP commented 1 day ago

Faced the same issue. Firefox 129.0.2. Mac M1 Sonoma 14.6.1.

Safari does not run into this error (but does run into an api endpoint not available error, which is irrelevant here).

I have not tried the pull request from mmtmn.

khorwood-openai commented 1 day ago

Hey all -- the issue here is that the Realtime API requires 24,000 Hz PCM data. I'll look into this separately to see if there's a solution for Firefox.

mmtmn commented 1 day ago

You will most likely have to resample the PCM data to 24,000 Hz. I did what I could on the PR without the access to the endpoint.