microsoft / MixedReality-WebRTC

MixedReality-WebRTC is a collection of components to help mixed reality app developers integrate audio and video real-time communication into their application and improve their collaborative experience
https://microsoft.github.io/MixedReality-WebRTC/
MIT License
898 stars 278 forks source link

NativePeers Transceivers only create RemoteVideoTracks with I420A encoding #782

Open SilverLive opened 3 years ago

SilverLive commented 3 years ago

Describe the problem Every Transceiver in "_nativePeer.AssociatedTransceivers" (which is used in the Method "HandleConnectionMessageAsync(SdpMessge message)" within "PeerConnection.cs") has the property "RemoteVideoTrack" who´s parameter "FrameEncoding" is always set to I420A . I'm frustrated because there is no findable way to define which RemoteVideoTrack-Encoding should be used.

Describe the solution you'd like I would like that both peers check their mediaLines wether the remoteVideoPlayer uses RGBA or I420a codec and than tell their nativePeers which kind of RemoteVideoSource their transceivers should prepare.

Another option could be to add the codec to the TransceiverInitSettings.

Describe alternatives you've considered I was trying to manually assign the encoding I need but it doesn´t work since the property is readonly.