Screensharing/Webcam media broken on Quest FxR

[emclaren]

Description When a user is screensharing or using the webcam in Hubs, this media does not show up on quest. It appears instead as a loading image and eventually turns into a broken media link.

I was in the Hubs room with the user as we were testing it. The content loads fine on desktop.

To Reproduce Steps to reproduce the behavior:

1. Go to Hubs room
2. Start Screensharing/webcam
3. Open room on Quest
4. See error

Expected behavior I expect the screenshare to appear as it does on other devices

Screenshots NA

Hardware

• Device: Quest

Additional context User is hoping to use this feature in a class soon to show a live video of a teacher, with students in Quests watching.

┆Issue is synchronized with this Jira Task

[gfodor]

I can't repro this on my quest, tested sharing both camera and screens from Firefox and Chrome from Windows.

[gfodor]

Can you post some more info about the sending context (platform, browser, what app being shared, etc)

[emclaren]

Reported from user: was screen sharing from a Windows computer running Chrome Version 77.0.3865.90 (Official Build) (64-bit). The viewer was on an Oculus Quest using the Firefox Reality Browser App

[misslivirose]

This is a duplicate of #1561

[misslivirose]

Actually, it looks like 1561 presents differently or used to present as an object loading infinitely instead of a broken media link.

[InfiniteLee]

I am able to reproduce with fxr on quest, but not with the oculus browser.

[InfiniteLee]

Well, I've tracked it down to this: the "video" MediaStream returned from naf-janus-adapter getMediaStream is never set to active on Quest when a desktop user starts streaming. My suspicion is that maybe this is being caused by a bug in the janus-plugin-sfu, as I've run through several of the video streaming examples on https://janus.conf.meetecho.com/demos.html between Firefox desktop and fxr on Quest and they all seem to work fine. This may also be the issue for #1533 and #1755, but I'm not sure.

[emclaren]

I corresponded with the user who flagged this and they confirmed that shared camera does work on their Oculus browser. The bug is only in Firefox Reality for them.

[arpu]

what i found out is my firefox on linux only support vp8 vp9

@InfiniteLee maybe the janus demos use vp9 in ff there is about:webrtc for debug infos

on janus side i get this offer from ff on linux

Processing JSEP offer from 0x7fbff4001f80: Sdp { v=0
o=mozilla...THIS_IS_SDPARTA-69.0.3 6352144198197779677 2 IN IP4 1.1.1.1
s=-
t=0 0
m=application 9 UDP/DTLS/SCTP webrtc-datachannel
c=IN IP4 1.1.1.1
a=sendrecv
a=end-of-candidates
m=audio 9 UDP/TLS/RTP/SAVPF 109 9 0 8 101
c=IN IP4 1.1.1.1
a=sendrecv
a=extmap:1 urn:ietf:params:rtp-hdrext:ssrc-audio-level
a=extmap:2/recvonly urn:ietf:params:rtp-hdrext:csrc-audio-level
a=extmap:3 urn:ietf:params:rtp-hdrext:sdes:mid
a=fmtp:109 maxplaybackrate=48000;stereo;useinbandfec=1;usedtx=1;sprop-stereo
a=fmtp:101 0-15
a=rtpmap:109 opus/48000/2
a=rtpmap:9 G722/8000/1
a=rtpmap:0 PCMU/8000
a=rtpmap:8 PCMA/8000
a=rtpmap:101 telephone-event/8000/1
m=video 9 UDP/TLS/RTP/SAVPF 121 120
c=IN IP4 1.1.1.1
a=sendrecv
a=extmap:3 urn:ietf:params:rtp-hdrext:sdes:mid
a=extmap:4 http://www.webrtc.org/experiments/rtp-hdrext/abs-send-time
a=extmap:5 urn:ietf:params:rtp-hdrext:toffset
a=fmtp:121 max-fs=12288;max-fr=60
a=fmtp:120 max-fs=12288;max-fr=60
a=rtcp-fb:121 nack
a=rtcp-fb:121 nack pli
a=rtcp-fb:121 ccm fir
a=rtcp-fb:121 goog-remb
a=rtcp-fb:120 nack
a=rtcp-fb:120 nack pli
a=rtcp-fb:120 ccm fir
a=rtcp-fb:120 goog-remb
a=rtpmap:121 VP9/90000
a=rtpmap:120 VP8/90000
 }
[WARN] Couldn't find codec we needed (h264) in the offer, rejecting video

[joshmarinacci]

Can this still be reproduced?

[emclaren]

This was reported by another user July 16, 2020

"Presenter used a screen share to present his slides through Google Slides. This was not visible on my Oculus Quest I could only see it on my laptop."