search

w3c / mediacapture-extensions

Extensions to Media Capture and Streams by the WebRTC Working Group
https://w3c.github.io/mediacapture-extensions/
Other
19 stars 14 forks source link

Face Detection: How metadata should be tied to requestVideoFrameCallback #71

Open youennf opened 1 year ago

youennf commented 1 year ago

rvfc can be used to grab information of video frames and do canvas painting. FaceDetection metadata can be useful in that context. There can be different approaches to how we could expose FaceDetection metadata in that context:

  1. Extend https://wicg.github.io/video-rvfc/#dictdef-videoframemetadata with an optional faceDetection object.
  2. Have the callback take a third additional parameter that would contain FaceDetection metadata (and potentially more).
  3. Create a new rvfc dedicated to FaceDetection
youennf commented 1 year ago

Option 1 is the most natural to me.

youennf commented 1 year ago

This relates to the proposal being made in https://github.com/w3c/mediacapture-extensions/pull/69.

ttoivone commented 1 year ago

The new VideoFrameMetadata entry and registry were created into WebCodecs, which should obsolete the metadata returned to requestVideoFrameCallback. Proposing to close this issue.