Open chrisn opened 6 years ago
A TAG review has now been requested for the codec and container switching addition to MSE.
During the IG call on 4 Jan 2018 (Minutes, Summary), @squapp from Fraunhofer Fokus presented their 360-degree video playout system, which identified some issues with Media Source Extensions:
Now that WICG is incubating new features for MSE, TPAC is an opportunity to review these requirements and propose work on API changes.
The IG call on 2 Oct 2018 about WebRTC also raised some ideas for low latency streaming using MSE.
Peter mentioned possible changes to MSE to provide controls over media playback behaviour for low latency streaming. The Interest Group could further analyse these ideas and advance them as part of the current work on new feature incubation for MSE.
SourceBuffer.appendFrame(frame)
SourceBuffer.setLiveness(liveness)
or SourceBuffer.setDelays(min, max)
HTMLMediaElement.setInterpolationBehavior
Please see also FOMS 2018 notes on MSE discussions for vNext feature incubations, many were focused on "low-latency" / "live" / "buffer management" / "GC interop-improvements":
Session 1: http://www.foms-workshop.org/foms2018/pmwiki.php/Site/MSE Session 2: http://www.foms-workshop.org/foms2018/pmwiki.php/Site/LL-MSE My high-level summary: MediaSource Extensions (MSE) (quite a lot covered, main points:)
Status update
Upcoming/in-progress work on MSE vNext:
Open ended discussion focused heavily on MSE vNext improvements around:
Many of these already have associated MSE github issues. Work will be ramping up on specifying solutions to these.
p.s. I wish I had been able to make it to TPAC this year to meet f2f with folks there, too, regarding MSE vNext feature ideas, proposals, and incubations. Please file issues or follow-up on existing ones in the main MSE github (https://github.com/w3c/media-source/issues) to help us gain traction on reaching ergonomic APIs that improve usability and interoperability of MSE.
@wolenetz Many thanks for sharing this! I note that similar ideas were mentioned in a recent IG call on low latency streaming.
Work on updating Media Source Extensions has started in the Web Platform Incubator Community Group (WICG). The repository is here.
The feature addition currently in development is support for codec and container switching. Please see the Intent to Implement and the explainer for details.
The ReadMe adds further guidance:
I encourage Interest Group members to review the codec switching changes, and also to suggest other new features as needed.
I suggest that we also review the Interest Group's own requirements for Media Source Extensions and coordinate submitting these to the MSE issue tracker. This includes previous submissions from CTA WAVE and Cloud Browser Task Force.