FusedVR / VRStreaming

Unity Render Streaming SDK to stream VR from CloudXR to WebXR over WebRTC
Apache License 2.0
147 stars 24 forks source link

[Feature] Bi-Directional Audio (Microphone Support) #21

Open vmohan7 opened 2 years ago

vmohan7 commented 2 years ago

Is your feature request related to a problem? Please describe.

For feature parity with Nvidia CloudXR, we will want bi-directional audio support to create multiplayer applications where players can talk with each other.

Describe the solution you'd like

Microphone support from WebXR that sends audio stream to Unity. Unity Render Streaming should have a sample that already supports this.

vmohan7 commented 2 years ago

Looks like Unity is working on this for the next release : https://github.com/Unity-Technologies/UnityRenderStreaming/pull/553/files

burakkaraceylan commented 2 years ago

There is a bug with sending audio bidirectionally. We have a hacky solution atm: https://github.com/Unity-Technologies/UnityRenderStreaming/issues/599

Edit: Nevermind. I just noticed you are the one who opened the issue on renderstreaming git :)

vmohan7 commented 2 years ago

There is a bug with sending audio bidirectionally. We have a hacky solution atm: Unity-Technologies/UnityRenderStreaming#599

Edit: Nevermind. I just noticed you are the one who opened the issue on renderstreaming git :)

Thanks for linking them. Just tested with the latest release and it almost works out of the box, but still broken unforunately