search

w3c / strategy

team-strat, on GitHub, working in public. Current state: DRAFT
158 stars 46 forks source link

360° video rendering #85

Open tidoust opened 7 years ago

tidoust commented 7 years ago

It is already possible to render 360° videos within a <video> element using MSE and custom controls, but the Web application needs to handle control interactions and adjust the underlying adaptive streaming accordingly.

It is also possible to render 360° videos within a VR headset through the WebVR spec, and spatialize audio through the Web Audio API, but the application needs to work with bytes and pixels for that to happen.

In both cases, native support for 360° video rendering would both simplify the life of developers and, more importantly, allow to take advantage of the device's capabilities for improved performance and efficiency.

This was identified as a topic of interest in the report of the Web & Virtual Reality Workshop

svgeesus commented 2 years ago

@tidoust is there any recent activity on this topic?

tidoust commented 2 years ago

One idea in that space was to standardize projection and 3D information in media containers, which led to the Spherical Video proposal for ISO BMFF (MP4) and WebM. That does not seem to have moved in the past couple of years though.

W3C groups that look into 360° videos to some extent:

In other words, there has not been recent activity on this topic that I'm aware of, but that is on the radar of different groups. From a Strategy team perspective, support for 360° video rendering has been raised again recently as a topic that could be worth looking into in explorations that @dontcallmedom and I are conducting to evaluate potential impacts of the metaverse on Web technologies. These explorations could perhaps lead to a workshop.