twilio / twilio-video-app-react

A collaboration application built with the twilio-video.js SDK and React.js
Apache License 2.0
1.8k stars 725 forks source link

Screen sharing audio capabilities and the ability to see your own shared content. #813

Open P3-J opened 1 year ago

P3-J commented 1 year ago

Question

When trying to get audio sharing to work with screen sharing, I found only one way to currently implement this. navigator.mediaDevices.getDisplayMedia({audio: true, video: true})

Any guidance towards a solution is appreciated. Thank you

P3-J commented 1 year ago

I would like to add to this. (p2p)

If one participant shares their screen with audio before the other participant joins, then the joining participant is able to hear the screenshare audio. But if screensharing with audio is started during a call then no audio is transmitted.

When looking at the track monitor then there is no difference. Even when playing audio the bandwidth seems to react to the audio, but still it is not heard. The track is subscribed to and published correctly.

As it seems to work perfectly if you share your screen before another person joins, then what could be the origin of the issue? As it is p2p it cannot be rule dependent, even though such an error would indicate exactly that.

As it seems to be a bug on Twilio's side then I am closing this question.

tracksmonitor