N23: Why share media between worker and main thread?

w3c / webrtc-nv-use-cases

Use cases for WebRTC NV

https://w3c.github.io/webrtc-nv-use-cases/

Other

32 stars 13 forks source link

N23: Why share media between worker and main thread? #13

Closed lgrahl closed 5 years ago

lgrahl commented 6 years ago

I'm not sure why it is required to share media between worker and main thread. Can someone elaborate which one of the mentioned use cases requires this and why?

Note that data exchange is already handled by N15, so I assume this is purely about audio/video.

aboba commented 5 years ago

@lgrahl Presumably this is to allow CPU-intensive processing (e.g. machine learning algorithms) without disrupting the main thread.

aboba commented 5 years ago

@lgrahl This is already supported for audio (via Audio Worklets) so the requirement is about efficient processing of raw video data. Can you prepare a PR?

lgrahl commented 5 years ago

Unless you want me to literally copy paste that text, someone else who has more experience with "funny hats" use cases is probably better suited to tackle that topic. :slightly_smiling_face: