The following demos utilize mediacapture-transform on input (transforming a MediaStreamTrack to VideoFrames) and output (going from VideoFrames to a MediaStreamTrack):
While demo #2 includes a reordering buffer, neither demo implements a jitter buffer. If you place a metronome or fan in the background, some jitter can be observed, though it is usually not extreme.
What smoothing functionality does the mediacapture-transform API provide in VideoTrackGenerator? No behavior is mandated in the specification. Is there an assumption that a jitter buffer is present upstream, or does the API provide some smoothing and/or synchronization functionality?
The following demos utilize mediacapture-transform on input (transforming a MediaStreamTrack to VideoFrames) and output (going from VideoFrames to a MediaStreamTrack):
While demo #2 includes a reordering buffer, neither demo implements a jitter buffer. If you place a metronome or fan in the background, some jitter can be observed, though it is usually not extreme.
What smoothing functionality does the mediacapture-transform API provide in VideoTrackGenerator? No behavior is mandated in the specification. Is there an assumption that a jitter buffer is present upstream, or does the API provide some smoothing and/or synchronization functionality?
Related: https://github.com/w3c/mediacapture-transform/issues/86