Yellow-Dog-Man / Resonite-Issues

Issue repository for Resonite.
https://resonite.com
121 stars 2 forks source link

Getting user Voice source for viseme analyzer #2341

Open Chipbonk opened 2 weeks ago

Chipbonk commented 2 weeks ago

Is your feature request related to a problem? Please describe.

I found myself in a situation where I wanted to be able to retrieve a users voice input for voice commands on a project and could not find a direct way to do this, just a few slightly jank ways. The hope was to be able to add a players voice to the source of a viseme analyzer so I could make wizards chess.

Describe the solution you'd like

The ability to have a user be assigned to the viseme analyzer to grab their voice Other have said and I also feel that having a node that straight up grabs their voice would be a bit of a privacy issue, so instead you would be able to just assign the local user to the analyzer.

Describe alternatives you've considered

I've been told and have thought about the "bypass" that would involve forcing a temp avatar onto the player, linking the voice to the analyzer, and then putting them back into their previous avatar, but that sounds just a little invasive. I haven't tried it or seen it done so maybe it's not.

Additional Context

The microphone has a "recording user" field and I'm kinda thinking of something similar and the "is recording" would be toggled by a little button or other activation means. Again though, I understand this can be a privacy concern for some. I've also thought about this idea on the previous platform where I would be using it to let a user that has a custom microphone have their voice broadcast into a theatre through speakers (which would be much cooler than just global mic status). Eventually, if more ways to mess with live audio input with bitrate change and effects and stuff, it would also be neat for walkie-talkie type items that could allow users to speak across the world privately without needing to use dm voice messages.

Requesters

"chippygirl" on discord, "Chippy" on resonite. Not sure if anyone else said "heck yeah I want that" while I was in the protoflux channel.

stawze commented 2 weeks ago

I also ran into this while working on something avatar-related. Being able to grab a user voice source would be handy but I don't know how it could be done in a privacy-respecting manner