w3c / mediacapture-transform

MediaStreamTrack Insertable Media Processing using Streams
https://w3c.github.io/mediacapture-transform/
Other
44 stars 20 forks source link

Spec is unclear when and how WebCodecs VideoFrame objects are created #106

Closed youennf closed 9 months ago

youennf commented 10 months ago

For MediaStreamTrackProcessor exposing camera content, implementations probably get information to create VideoFrame objects. For MediaStreamTrackProcessor exposing VideoTrackGenerator content, the VideoFrame exposed by MediaStreamTrackProcessor is not the JS object written in VideoTrackGenerator but a clone.

We should describe this in the spec. And we should make sure that video frames are correctly closed.