search

nvpro-samples / vk_video_samples

Vulkan video samples
Apache License 2.0
237 stars 40 forks source link

Nvidia Streamline integration #43

Closed BattleAxeVR closed 1 year ago

BattleAxeVR commented 1 year ago

Hi there, I was wondering if anyone at Nvidia considered whether to integrate Vulkan Video (or other video decoding backends by NV or others) into Streamline SDK. It seems like an ideal way to go about helping people get this thing integrated into their games / game engines with minimal effort.

As you know, I already integrated Vulkan Video (with help of this sample) into my Vulkan-only engine, but, with each new update, I'm thinking there are a lot too many low-level details to care about here, and Vulkan-API in itself may be a show-stopper for some engines. It would be better to abstract away the use of Vulkan Video probably, in lieu of Streamline that would be multi-API with a simple configuration. Like how they did it for NRD or DLSS Frame Generation vs normal DLSS / XeSS / FSR upscaling support.

Any thoughts? I've realized over the past couple years how much time it's cost me to keep these libs up to date and it is really a drain. "Streamlining" this work, so to speak, would go a long way to helping make things go more smoothly / efficiently. NRD in particular was very challenging to integrate for me, so I welcome the relief that StreamLine is providing here.

Just a suggestion...

zlatinski commented 1 year ago

Thank you, Bela, for the suggestion! I think it is a good idea. I'm checking internally if this is something we can plan on doing.

BattleAxeVR commented 1 year ago

Thanks Tony, let me know either way and I'll close the issue then. I wasn't sure whether to open it here or on the Streamline repo itself.