Suggested by @jan-ivar here.
@aboba touched upon this here
In many cases, it might be important to have access to the original camera feed, so BG MASK retains the original frames intact, does segmentation and provides mask frames in addition to the original video frames thus web applications receive both the original frames and mask data.
As per requirement of the VideoFrame Metadata Registry, this issue has been filed to allow discussion about the Background Segmentation MASK metadata on being added into VideoFrameMetadata dictionary. The proposal is in the https://github.com/w3c/mediacapture-extensions/pull/142
Suggested by @jan-ivar here. @aboba touched upon this here
In many cases, it might be important to have access to the original camera feed, so BG MASK retains the original frames intact, does segmentation and provides mask frames in addition to the original video frames thus web applications receive both the original frames and mask data.
Explainer