Yellow-Dog-Man / Resonite-Issues

Issue repository for Resonite.
https://resonite.com
135 stars 2 forks source link

Live spatial audio listener/mirror #1273

Open amplified1 opened 8 months ago

amplified1 commented 8 months ago

Is your feature request related to a problem? Please describe.

I checked the other audio related feature requests and none of them seemed to include this specifically. I would like to create items that listen to audio around them like a player would and then output that directly to an audio output, uses cases involve walkie talkies, phones, intercom systems, stage mics, etc. If it is feasible with how the game's audio system functions I think this would add a lot for making immersive and adaptive communication and audio systems in worlds.

Describe the solution you'd like

Add a component that acts like a player's ears but outputs to an audio source. Essentially an audio version of the functionality of a camera and render texture, if this is possible at all with the game's audio systems.

Describe alternatives you've considered

There is also no easy way to dynamically grab voice sources from players or modify their voice volume without using bad practices, this would be good for similar use cases and probably be easier to implement, but copying someone's voice source for a phone/walkie talkie type setup would lack the aspect of hearing other nearby voices and world audio.

Additional Context

possibly related to #335 & #567

amplified1 commented 8 months ago

Oh yeah, also, much like cameras, these should be able to whitelist & blacklist hierarchies of sound, to avoid feedback loops and allow for more fine-tuned control for creators.

Frooxius commented 8 months ago

We'd like to add something like this, but we will have to switch to a different audio engine. We're using Unity's audio system (with the Steam Audio spatializer) for rendering spatial audio, but it only supports a single listener.

Which means, don't expect this soon.

We will have to switch to a different audio system once we switch away from Unity, so having one that supports multiple listeners should come at some point.