search

w3c / media-source

Media Source Extensions
https://w3c.github.io/media-source/
Other
267 stars 59 forks source link

MSE-in-Workers: {Audio,Video,Text}Track{,List} IDL in HTML need additional DedicatedWorker in Exposed #280

Open wolenetz opened 3 years ago

wolenetz commented 3 years ago

MSE-in-Workers feature issue is #175.

This issue tracks making sure the extended HTML AudioTrack, VideoTrack, TextTrack, and their *TrackList IDLs are all updated to have exposure to both Window and DedicatedWorker, not just Window.

In the initial spec draft of MSE-in-Workers, the assumption is made that such exposure is already included in HTML, but at the moment of filing this issue, it hasn't.

Per WebIDL https://heycam.github.io/webidl/#Exposed, it looks like HTML spec's original definitions of these IDL would need to include DedicatedWorker in their Exposed (otherwise, some significant rework or even removal of track/tracklist visibility in MSE-in-Worker would be necessary):

If [Exposed] appears on a partial interface or partial namespace, then the partial’s own exposure set must be a subset of the exposure set of the partial’s original interface or namespace.

wolenetz commented 2 years ago

Requesting this be discussed at Sept 14 Media WG meeting.

foolip commented 2 years ago

I noticed this issue because HTML's and MSE's Web IDL put together are invalid right now, causing test failures in https://github.com/web-platform-tests/wpt/pull/29414.

I can't find an issue about this in HTML yet, would be great if someone could file an issue at https://github.com/whatwg/html/issues/new.

wolenetz commented 1 year ago

I've reactivated the most closely related Chromium implementation bug (https://crbug.com/487288) to help track fixing this issue in implementation, too (currently behind the experimental AudioVideoTracks blink runtime-enabled feature).

jyavenard commented 4 months ago

There are unfortunately much more DOM objects that need updating, in particular TextTrackCueList / TextTrackCue ; in TextTrack the method addCue and removeCue which have references on how they are to be rendered on the MediaElement (https://w3c.github.io/webvtt/#rules-for-updating-the-display-of-webvtt-text-tracks) with their respective CSS block boxes etc.. while those examples are in relation to WebVTT, there's nothing preventing the use of WebVTT cues in inbandTextTrack

None of which is applicable with DedicatedWorker