luttje / gmod-experiment-redux

'Experiment' is an FPS RPG for the Helix framework in Garry's Mod.
https://experiment.games/
MIT License
6 stars 0 forks source link

Voice Activated Buffs/Events with gm_8bit #82

Open utaysi opened 2 months ago

utaysi commented 2 months ago

You mentioned on discord that you are using the gm_8bit repo for voice transcriptions. I am not sure how fast it processes the voice chat of the users and if this idea is viable, but if it is fast enough this could be a fun and unique way the users can interact with the game.

Just like how caster classes cast buffs before entering dungeon/raids in MMORPG's which grant small increased stats, a player can speak certain keywords for specific buffs to grant small buffs before combat. Since the lore of the gamemode is that the AI is constantly watching and communicating via the screens, it can be triggered with a keyword which could be the "name of the AI". For the sake of the examples, let's call the AI Alexa, but it could be something cooler that fits the lore.

Attribute Boosters:

...

This voice activation idea could be used to trigger all sorts of other things, such as world events, etc. I think it is a unique way to interact with the game and it would be very cool for players.

luttje commented 2 months ago

Haha, amazing ideas! Really inspiring and awesome that you considered how it would integrate with the story.

So as to the speed: transcribing is very slow (up to 5 seconds). However I believe what you're describing is 'voice activation', which can be a lot faster (just look at how fast your phone mistakes anything you say for 'Hey Siri'/'Ok Google').

I'd have to look further into it to see whats possible, but perhaps hotwords is what I'm looking for in the transcription model we're using for speech recognition.

For now I'll mark this as low priority, however this does sound unique and fun, so I may find time to look into it sooner.

Thanks for your continued contributions!