search

keijiro / KlakHap

HAP video player plugin for Unity
Other
337 stars 27 forks source link

Feature request; audio playback #26

Open mikerz opened 4 years ago

mikerz commented 4 years ago

Hi, I love the frame accurate nature of your plugin, but wish it had audio. The use case is in content production.

I’d be looking for surround sound support.

keijiro commented 4 years ago

It would be a nice-to-have feature, but it requires lots of time to implement in a proper way. Unfortunately, I don't have enough time for it.

I'd like to keep this issue ticket opened, but please don't expect that I'll work on it.

By the way, do you have any experience on surround sound with Unity? I only tried it several years ago. I'm not sure how it works on the recent versions of Unity.

mikerz commented 4 years ago

Understood; there currently doesn't seem to be an ideal HAP playback route for unity. Demolition HAP looked really good, but it's kind of abandoned and very broken with metal. It was also causing some build issues. AVPro with Directshow generally works fine, but it's not centered on frame-accurate playback and it seems inaccurate.

I haven't had much experienced on surround sound in Unity; the demolition hap plugin handles it based on all of Unity's sound preferences (5.1, 7.1, etc) if you wanted an example. I'm probably going to have to place each channel on its own audiosource and spatialize them since I need it to work with the head transform.

tim-williams-bi commented 1 month ago

Dang, was going to use this but without audio video playback is kind of moot in most cases

mikerz commented 1 month ago

FWIW AVProVideo now has excellent hap playback capabilities (as well as notchlc)