search

microsoft / MixedReality-WebRTC

MixedReality-WebRTC is a collection of components to help mixed reality app developers integrate audio and video real-time communication into their application and improve their collaborative experience
https://microsoft.github.io/MixedReality-WebRTC/
MIT License
898 stars 277 forks source link

Not able to see Remote video when connected to different network #859

Open deepak24ti opened 2 years ago

deepak24ti commented 2 years ago

Describe the bug I am using 2 devices:

  1. Unity Editor in Laptop
  2. Hololens 2 with same application deployed

Using google stun server stun1.l.google.com:19302 NodeDSSSignaler.HTTPServerAddress also address of machine where signaler is running.

When I run the application with in same network. I am getting local as well as remote feed as expected. But as soon as, I connect one of the device to different network. I am not getting remote feed. I can see data is getting exchanged between devices but i am not seeing remote video.

To Reproduce Steps to reproduce the behavior:

  1. Run Unity Editor and signaling server in Laptop
  2. Deploy same application in Hololens2
  3. And connect Hololens to some other network
  4. Start Connection Remote video is not visible

Expected behavior Local Feed and remote feed should be visible in Hololens as well as in Unity editor while connected in different network.

SDP messages

Offer message v=0\r\no=- 6137189567919884102 2 IN IP4 127.0.0.1\r\ns=-\r\nt=0 0\r\na=group:BUNDLE 0 1\r\na=msid-semantic: WMS\r\nm=audio 9 UDP/TLS/RTP/SAVPF 111 103 104 9 102 0 8 106 105 13 110 112 113 126\r\nc=IN IP4 0.0.0.0\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=ice-ufrag:QNyN\r\na=ice-pwd:rsyTYXklZL6IoK3MXULQgxjm\r\na=ice-options:trickle\r\na=fingerprint:sha-256 34:E1:B5:B7:F9:26:1C:8B:02:B0:3F:F4:2A:14:1E:64:B3:26:67:70:50:5F:16:47:85:40:D9:EE:05:71:4E:DE\r\na=setup:actpass\r\na=mid:0\r\na=extmap:1 urn:ietf:params:rtp-hdrext:ssrc-audio-level\r\na=extmap:9 urn:ietf:params:rtp-hdrext:sdes:mid\r\na=sendrecv\r\na=msid:- 91d012c4-b147-408d-9277-f9f290dd49cc\r\na=rtcp-mux\r\na=rtpmap:111 opus/48000/2\r\na=rtcp-fb:111 transport-cc\r\na=fmtp:111 minptime=10;useinbandfec=1\r\na=rtpmap:103 ISAC/16000\r\na=rtpmap:104 ISAC/32000\r\na=rtpmap:9 G722/8000\r\na=rtpmap:102 ILBC/8000\r\na=rtpmap:0 PCMU/8000\r\na=rtpmap:8 PCMA/8000\r\na=rtpmap:106 CN/32000\r\na=rtpmap:105 CN/16000\r\na=rtpmap:13 CN/8000\r\na=rtpmap:110 telephone-event/48000\r\na=rtpmap:112 telephone-event/32000\r\na=rtpmap:113 telephone-event/16000\r\na=rtpmap:126 telephone-event/8000\r\na=ssrc:1141733944 cname:KYMYFYUvHKVWmvqI\r\na=ssrc:1141733944 msid: 91d012c4-b147-408d-9277-f9f290dd49cc\r\na=ssrc:1141733944 mslabel:\r\na=ssrc:1141733944 label:91d012c4-b147-408d-9277-f9f290dd49cc\r\nm=video 9 UDP/TLS/RTP/SAVPF 96 97 98 99 100 101 127 124 125\r\nc=IN IP4 0.0.0.0\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=ice-ufrag:QNyN\r\na=ice-pwd:rsyTYXklZL6IoK3MXULQgxjm\r\na=ice-options:trickle\r\na=fingerprint:sha-256 34:E1:B5:B7:F9:26:1C:8B:02:B0:3F:F4:2A:14:1E:64:B3:26:67:70:50:5F:16:47:85:40:D9:EE:05:71:4E:DE\r\na=setup:actpass\r\na=mid:1\r\na=extmap:2 urn:ietf:params:rtp-hdrext:toffset\r\na=extmap:3 http://www.webrtc.org/experiments/rtp-hdrext/abs-send-time\r\na=extmap:4 urn:3gpp:video-orientation\r\na=extmap:5 http://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01\r\na=extmap:6 http://www.webrtc.org/experiments/rtp-hdrext/playout-delay\r\na=extmap:7 http://www.webrtc.org/experiments/rtp-hdrext/video-content-type\r\na=extmap:8 http://www.webrtc.org/experiments/rtp-hdrext/video-timing\r\na=extmap:10 http://tools.ietf.org/html/draft-ietf-avtext-framemarking-07\r\na=extmap:9 urn:ietf:params:rtp-hdrext:sdes:mid\r\na=sendrecv\r\na=msid:- af4b1ce4-d066-4514-baa7-5b26f3937080\r\na=rtcp-mux\r\na=rtcp-rsize\r\na=rtpmap:96 VP8/90000\r\na=rtcp-fb:96 goog-remb\r\na=rtcp-fb:96 transport-cc\r\na=rtcp-fb:96 ccm fir\r\na=rtcp-fb:96 nack\r\na=rtcp-fb:96 nack pli\r\na=rtpmap:97 rtx/90000\r\na=fmtp:97 apt=96\r\na=rtpmap:98 VP9/90000\r\na=rtcp-fb:98 goog-remb\r\na=rtcp-fb:98 transport-cc\r\na=rtcp-fb:98 ccm fir\r\na=rtcp-fb:98 nack\r\na=rtcp-fb:98 nack pli\r\na=fmtp:98 x-google-profile-id=0\r\na=rtpmap:99 rtx/90000\r\na=fmtp:99 apt=98\r\na=rtpmap:100 multiplex/90000\r\na=rtcp-fb:100 goog-remb\r\na=rtcp-fb:100 transport-cc\r\na=rtcp-fb:100 ccm fir\r\na=rtcp-fb:100 nack\r\na=rtcp-fb:100 nack pli\r\na=fmtp:100 acn=VP9;x-google-profile-id=0\r\na=rtpmap:101 rtx/90000\r\na=fmtp:101 apt=100\r\na=rtpmap:127 red/90000\r\na=rtpmap:124 rtx/90000\r\na=fmtp:124 apt=127\r\na=rtpmap:125 ulpfec/90000\r\na=ssrc-group:FID 964604763 3771101188\r\na=ssrc:964604763 cname:KYMYFYUvHKVWmvqI\r\na=ssrc:964604763 msid: af4b1ce4-d066-4514-baa7-5b26f3937080\r\na=ssrc:964604763 mslabel:\r\na=ssrc:964604763 label:af4b1ce4-d066-4514-baa7-5b26f3937080\r\na=ssrc:3771101188 cname:KYMYFYUvHKVWmvqI\r\na=ssrc:3771101188 msid: af4b1ce4-d066-4514-baa7-5b26f3937080\r\na=ssrc:3771101188 mslabel:\r\na=ssrc:3771101188 label:af4b1ce4-d066-4514-baa7-5b26f3937080\r\n","IceDataSeparator":"
Answer message v=0\r\no=- 1200433666125703991 2 IN IP4 127.0.0.1\r\ns=-\r\nt=0 0\r\na=group:BUNDLE 0 1\r\na=msid-semantic: WMS\r\nm=audio 9 UDP/TLS/RTP/SAVPF 111 103 9 102 0 8 105 13 110 113 126\r\nc=IN IP4 0.0.0.0\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=ice-ufrag:/P6E\r\na=ice-pwd:WfaEFZw61Aj6qJ0S7nwfo/4w\r\na=ice-options:trickle\r\na=fingerprint:sha-256 C2:B7:4E:F6:04:36:3A:09:1C:80:33:64:E5:7A:2C:43:16:C9:53:9C:63:02:E9:0B:97:ED:BB:50:36:81:32:DE\r\na=setup:active\r\na=mid:0\r\na=extmap:1 urn:ietf:params:rtp-hdrext:ssrc-audio-level\r\na=extmap:9 urn:ietf:params:rtp-hdrext:sdes:mid\r\na=sendrecv\r\na=msid:- 33dbd625-739e-4c62-a3d0-908f0762b1a4\r\na=rtcp-mux\r\na=rtpmap:111 opus/48000/2\r\na=rtcp-fb:111 transport-cc\r\na=fmtp:111 minptime=10;useinbandfec=1\r\na=rtpmap:103 ISAC/16000\r\na=rtpmap:9 G722/8000\r\na=rtpmap:102 ILBC/8000\r\na=rtpmap:0 PCMU/8000\r\na=rtpmap:8 PCMA/8000\r\na=rtpmap:105 CN/16000\r\na=rtpmap:13 CN/8000\r\na=rtpmap:110 telephone-event/48000\r\na=rtpmap:113 telephone-event/16000\r\na=rtpmap:126 telephone-event/8000\r\na=ssrc:4178924293 cname:rF+pXTmex2hI/isP\r\nm=video 9 UDP/TLS/RTP/SAVPF 96 97 98 99 127 124 125\r\nc=IN IP4 0.0.0.0\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=ice-ufrag:/P6E\r\na=ice-pwd:WfaEFZw61Aj6qJ0S7nwfo/4w\r\na=ice-options:trickle\r\na=fingerprint:sha-256 C2:B7:4E:F6:04:36:3A:09:1C:80:33:64:E5:7A:2C:43:16:C9:53:9C:63:02:E9:0B:97:ED:BB:50:36:81:32:DE\r\na=setup:active\r\na=mid:1\r\na=extmap:2 urn:ietf:params:rtp-hdrext:toffset\r\na=extmap:3 http://www.webrtc.org/experiments/rtp-hdrext/abs-send-time\r\na=extmap:4 urn:3gpp:video-orientation\r\na=extmap:5 http://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01\r\na=extmap:6 http://www.webrtc.org/experiments/rtp-hdrext/playout-delay\r\na=extmap:7 http://www.webrtc.org/experiments/rtp-hdrext/video-content-type\r\na=extmap:8 http://www.webrtc.org/experiments/rtp-hdrext/video-timing\r\na=extmap:10 http://tools.ietf.org/html/draft-ietf-avtext-framemarking-07\r\na=extmap:9 urn:ietf:params:rtp-hdrext:sdes:mid\r\na=sendrecv\r\na=msid:- 644b76a7-189a-4ada-948e-5276aef4abe3\r\na=rtcp-mux\r\na=rtcp-rsize\r\na=rtpmap:96 VP8/90000\r\na=rtcp-fb:96 goog-remb\r\na=rtcp-fb:96 transport-cc\r\na=rtcp-fb:96 ccm fir\r\na=rtcp-fb:96 nack\r\na=rtcp-fb:96 nack pli\r\na=rtpmap:97 rtx/90000\r\na=fmtp:97 apt=96\r\na=rtpmap:98 VP9/90000\r\na=rtcp-fb:98 goog-remb\r\na=rtcp-fb:98 transport-cc\r\na=rtcp-fb:98 ccm fir\r\na=rtcp-fb:98 nack\r\na=rtcp-fb:98 nack pli\r\na=fmtp:98 x-google-profile-id=0\r\na=rtpmap:99 rtx/90000\r\na=fmtp:99 apt=98\r\na=rtpmap:127 red/90000\r\na=rtpmap:124 rtx/90000\r\na=fmtp:124 apt=127\r\na=rtpmap:125 ulpfec/90000\r\na=ssrc-group:FID 223524702 3528551019\r\na=ssrc:223524702 cname:rF+pXTmex2hI/isP\r\na=ssrc:3528551019 cname:rF+pXTmex2hI/isP\r\n","IceDataSeparator":"

Screenshots

image

image