[HELP NEEDED] Google meet in google chrome vs captureStream

[KopiasCsaba]

Hi, this is me, the author of this extension:)

I'm experiencing a strange bug, and after a day I could not find a solution for this. If any of you have any ideas, let me know!

Steps to reproduce:

• Use the extension
• Use google chrome
• Use google meet
• Join from an android device
  • Tested from the meets app
  • Tested from F-Droid Fennec (firefox), in desktop view
• Wait a little

The result:

• The android client's image starts to flicker or turns to black completely.

What's tracked down

• The problem happens, if (not when) we call the captureStream method on the <video> element.
• It happens under windows 10, and windows 7 (virtualised), and ubuntu 20.04 (with and without hardware acceleration enabled)
• Either front or back camera can be used, the bug will happen

Deductions

• Seemingly it is operating system independent
• It does not happen while using a webcam on the same machine
• I'm guessing this glitch is underlying captureStream and probably codec or frame size or fps dependent.

Extracted testcase

In order to make the test case as small as possible, it is repeatable with this code:

v = document.createElement('video')
v.setAttribute('width',200);
v.setAttribute('height',200);
v.style.zIndex=999999999999;
v.style.background='red';
v.style.position='absolute';
document.querySelector('body').appendChild(v);
var s =  document.querySelectorAll('video:not(.sfVideo)')[1].captureStream(100);
v.srcObject=s;
v.play();

Usage note:

• Just copy it to the dev console, if you know what all this is.
• change [1] in line -3 to the appropriate index in order to copy the stream incoming from the android device.

This is what this will do:

And after a minute or so it will turn to this:

[KopiasCsaba]

I have opened a chrome issue for this, we'll see: https://bugs.chromium.org/p/chromium/issues/detail?id=1167894

Star it in their bugtracker if you encounter this one.