WebRTC support

[orange3134]

Is your feature request related to a problem? Please describe.

I would like Resonite to have the ability to deliver video with low latency. It helps to create pieces that interact with reality through the camera. It also helps to share the screen with people in the session.

I currently watch RTMP streaming for these purposes on my in-game video player, but there is a delay of 1 or 2 seconds even on a good network.

Describe the solution you'd like

How about supporting video streaming via WebRTC?

I often see WebRTC being used for low latency video streaming. It could be streamed with a small delay of a few hundred milliseconds.

Describe alternatives you've considered

Use RTMP streaming as before.

Additional Context

No response

Requesters

orange3134

[Psychpsyo]

If this happens, I'd like access to data channels as well as video/audio.

[Flam3z]

this feature would be another really great addition on top of the many others i've seen so far. Correct me if im wrong but isnt webRTC a big privacy and security risk generally speaking? if im wrong plz lmk

[Psychpsyo]

this feature would be another really great addition on top of the many others i've seen so far. Correct me if im wrong but isnt webRTC a big privacy and security risk generally speaking? if im wrong plz lmk

The only privacy issue with webRTC is that, depending on the implementation, it will reveal your IP address to the people you're connecting to and the signalling server. Which is pretty much a given for anything peer-to-peer and if you don't want that, you should be using a VPN.

[rabbuttz]

I don't understand the reason, but RTMP and RTSP have a larger delay than expected within Resonite. If this could be made stable and low-latency like Discord's screen sharing via WebRTC, it would be fantastic. Especially for having smooth conversations with AI bots, which are sure to become popular, it's necessary to share media interactively between inside and outside of Resonite via WebRTC.

In fact, my dream is to have seamless conversations with AI within Resonite. Also, it would be amazing to have video calls with people in other sessions, just like in "Ready Player One." Additionally, it seems useful for creating real-time translation features. I believe introducing WebRTC could make Resonite more attractive and futuristic.

[AmasterAmaster]

I would like to see this be bi-directional, meaning to have a way for audio/video to be sent into Resonite, and to have audio/video be sent from Resonite to somewhere else externally. Similar to how we have it with other networking interfaces that we have.

[GrandtheUK]

Having some way to get video out of Resonite without being in VR and using the camera control's "Mirror to Display" feature would help people in desktop have other camera positions than their own while being still able to see from their own perspective.

Even just one camera's video getting out would be useful since we have camera anchors that can be switched between fairly easily but we need a way to get the video out