search

nvpro-samples / vk_video_samples

Vulkan video samples
Apache License 2.0
266 stars 43 forks source link

Multi-layer HEVC support #64

Open BattleAxeVR opened 9 months ago

BattleAxeVR commented 9 months ago

Hi, I noticed there is in the source code support for Multi-layer HEVC files. Can you explain a bit more about how it works, and how I can read the decoded video frames from each individual layer? I could really use this for my game engine rather than creating a separate instance of vulkan video decoding and ham-fisting synchronization between separate video files.

zlatinski commented 9 months ago

Hi @BattleAxeVR, We have a tentative plan to provide an MV solution for both h.264 and HEVC by the end of the year. Please note that for this to work, we also need a set of Khronos Vulkan-video extensions.

BattleAxeVR commented 9 months ago

I presume this is also useful for multi-view HEVC that would benefit not only RGB + A or RGB + D, but also stereo RGB in a single pass, right? For XR stuff.

Thanks for the heads up, I'll roll my own solution in the meanwhile but it would be nice to clean it up / simplify it before I launch my game.