udevbe / greenfield

HTML5 Wayland compositor :seedling:
GNU Affero General Public License v3.0
918 stars 28 forks source link

WebRTC/ORTC? #1

Closed neuronsupport closed 6 years ago

neuronsupport commented 6 years ago

Hi, I was wondering how you utilize WebRTC/ORTC? are you streaming composited screen image to browser thru WebRTC/ORTC?

Zubnix commented 6 years ago

No, each individual application will have it's raw content live encoded on the server to a h264 frame, after which it's send using it's own dedicated webrtc datachannel, which is configured to use UDP. On reception in the browser, the h264 frame is decoded using a wasm h264 decoder, and drawn in it's own dedicated application canvas. As such the entire 'composited' image you see in the browser is created in the browser itself using ordinary dom elements.

neuronsupport commented 6 years ago

I see so it is working similar to VNC but each application has its HTML5 canvas element instead of a grand canvas drawing all.