w3c / webcodecs

WebCodecs is a flexible web API for encoding and decoding audio and video.
https://w3c.github.io/webcodecs/
Other
937 stars 131 forks source link

Announcement: Background Segmentation metadata entry to WebCodecs VideoFrame Metadata Registry #800

Open riju opened 3 weeks ago

riju commented 3 weeks ago

As per requirement of the VideoFrame Metadata Registry, this issue has been filed to allow discussion about the Background Segmentation MASK metadata on being added into VideoFrameMetadata dictionary. The proposal is in the https://github.com/w3c/mediacapture-extensions/pull/142

Suggested by @jan-ivar here. @aboba touched upon this here

In many cases, it might be important to have access to the original camera feed, so BG MASK retains the original frames intact, does segmentation and provides mask frames in addition to the original video frames thus web applications receive both the original frames and mask data.

Explainer

chrisn commented 2 weeks ago

Thanks @riju, I'll add this to the Media WG meeting agenda for 18 June.