search

Kartaverse / Spatial-Metadata

The KartaLink "Spatial Metadata" tools allow you to prepare immersive content for playback on Apple Vision Pro and Meta Quest HMDs
GNU Lesser General Public License v2.1
73 stars 6 forks source link

Please also add the ability to make Metadata encoding for VR 360 3D for YouTube possible #4

Open pbaerthel opened 2 months ago

pbaerthel commented 2 months ago

After some tests…. Sadly it’s not working for me. I’ve an 8K VR 360 3D Over and Under Video. Already finished to upload it to YouTube and would use the injector on my M3 Max MacBook Pro to set the Metadata for YouTube. But no matter what I’m trying after encoding I get only an 2D 360 Video out. No 3D. After encoding you already see that the file doesn’t contain the second eye anymore. Please fix it. You’ve the only Apple silicon friendly solution with UI

AndrewHazelden commented 2 months ago

Currently the MV-HEVC metadata system is aimed at native VR video playback from local storage on an Apple Vision Pro HMD or a Meta Quest 3 (v68+ firmware). It is a multi-view container format that has the left and right eyes stored in separate buffers which allows for data rate reduction by doing differential encoding between the stereo views, ontop of regular MP4 H.265 encoding on the temporal difference between frames in a video sequence.

FWIW, I've not seen Google YouTube 360 guides yet that discuss the specifics of YouTube's support for MV-HEVC but expect it will be clarified sooner, rather than later, as iPhone 15 Pro cameras shoot spatial video with a SBS dual lens camera setup so lots of content in this format will arrive on YouTube.