microsoft / MixedReality-WebRTC

MixedReality-WebRTC is a collection of components to help mixed reality app developers integrate audio and video real-time communication into their application and improve their collaborative experience
https://microsoft.github.io/MixedReality-WebRTC/
MIT License
898 stars 278 forks source link

Desktop-Hololens/Unity Communication #807

Open xuhaozheng opened 2 years ago

xuhaozheng commented 2 years ago

Since the desktop only uses NamedPipeSignaler as a signaler while the UWP and Unity Application use NodeDss as a signaler. How can desktop app communicate with Unity/UWP application?

I want to stream OBS virtual camera from desktop to Hololens2. I wonder whether there are some common solutions that enable the communication between desktop and Unity/UWP considering WebRTC is a universal platform for different devices.

Can desktop app support NodeDss signaler?

djee-ms commented 2 years ago

All signalers are just examples, there's nothing blocking you from using any signaler with the Unity/UWP/Desktop libraries. We just provide two different examples. If you want to use node-dss with the Desktop test app, you can adapt the Unity signaler component NodeDssSignaler and make it into a C# node-dss signaler.

xuhaozheng commented 2 years ago

Thank you for your suggestion. I'm adapting the NodeDssSignaler for Desktop app. I found the Unity signaler component uses some Unity built-in functions so I try to adapt the NodeDssSignaler in UWP. Do you think whether it's practical? So far, I'm stuck with the event handler in UWP app:

_peerConnection.LocalSdpReadytoSend += Peer_LocalSdpReadytoSend; _peerConnection.IceCandidateReadytoSend += Peer_IceCandidateReadytoSend;

It seems in the desktop app the latter function can only be recognized as an object rather than a function. Do You have any suggestions about this?

Another question is that how to add createoffer() in desktop which is controlled by a button in UWP?

Sorry I'm a new programmer for .Net and UWP.