jwebmeister / tacspeak

Tacspeak - Fast, lightweight, modular speech recognition for gaming
GNU Affero General Public License v3.0
44 stars 2 forks source link

No disarm trap voice command in tacspeak #4

Closed madmaximus101 closed 9 months ago

madmaximus101 commented 9 months ago

Currently as far as I know there is no voice command to disarm traps? From recent memory this is the only option i can recall having to order teammates to disarm trap. If i find any other command menu options for this i will let you know. Thankyou

20231217150649_1

jwebmeister commented 9 months ago

Thanks for the screenshot. I'll update soon.

So annoying that it's inserted halfway in the list of door options, so all the keys corresponding to the commands for wedge, cover and open are completely different if it's a door with a trap on it or not. /endrant I'm hoping Void notices Tacspeak and looks to improve the command menu for a better player experience when using Tacspeak, or other speech recognition software, or in the base game in general. /reallyendrant

jwebmeister commented 9 months ago

Example spoken commands (not exhaustive):

The command keys will shift appropriately for the affected commands (wedge, cover, open / close door) if the user says it's a "trapped" door, or it will default to the command keys for an non-trapped door if the user does not say "trapped".

Will package as release 0.1.2 very soon.

madmaximus101 commented 9 months ago

wow that was quick! amazing work mate :)

jwebmeister commented 9 months ago

Done! Release 0.1.2

madmaximus101 commented 9 months ago

Done! Release 0.1.2

Confirmed working. Found a door with trap. A.I teammates were unaware trap existed so option to disarm didnt exist. Ordered teammate to mirror the door then the option to disarm trap appeared. Used the command "disarm trap" and it worked instantly without issue!

madmaximus101 commented 9 months ago

Mate i am strongly of the opinion you have something genuinely amazing here. Something you could actually make some money off. Create some sort of base program - with forks for different games, addons etc - unsure how you'd go about that but hey, ideas! This speech app you've made is beyond anything I've tried before. It probably helps that I'm aussie, probs why works so gosh darn well for me heh. If you do decide to go further, maybe involve others with an American accent or English, European, South African, Asian etc. Flesh out the recognition. I have nothing of note or significance to contribute to your endeavor, as i have very rudimentary understanding of .py files and the logic, programming etc. Consider me a blown away, very thankful user of your software. Amazing mate. Your doing an awesome thing.

On Sun, Dec 17, 2023 at 5:48 PM Joshua Webb @.***> wrote:

Done! Release 0.1.2 https://github.com/jwebmeister/tacspeak/releases/tag/0.1.2

— Reply to this email directly, view it on GitHub https://github.com/jwebmeister/tacspeak/issues/4#issuecomment-1859069874, or unsubscribe https://github.com/notifications/unsubscribe-auth/BEXH6Y5E7PDV7ARXGCXU5WTYJ2TDVAVCNFSM6AAAAABAYEAJZSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNJZGA3DSOBXGQ . You are receiving this because you modified the open/close state.Message ID: @.***>

jwebmeister commented 9 months ago

Mate i am strongly of the opinion you have something genuinely amazing here. Something you could actually make some money off. Create some sort of base program - with forks for different games, addons etc - unsure how you'd go about that but hey, ideas! This speech app you've made is beyond anything I've tried before. It probably helps that I'm aussie, probs why works so gosh darn well for me heh. If you do decide to go further, maybe involve others with an American accent or English, European, South African, Asian etc. Flesh out the recognition. I have nothing of note or significance to contribute to your endeavor, as i have very rudimentary understanding of .py files and the logic, programming etc. Consider me a blown away, very thankful user of your software. Amazing mate. Your doing an awesome thing.

The heavy lifting is being done by Dragonfly and Kaldi Active Grammar. Both are free open-source projects, and amazing. The use + license of KAG requires this project be released open-source under the same license, not that I would've chosen to do otherwise.

Donations are an option, and would very much be appreciated, but / and I'll keep fleshing out Tacspeak as long as I can.

The mechanism of how KAG activates / deactivates parts of the model is how it works so well where others fall down for this use-case, or at least that's what I believe from researching, testing and comparing various models. The model hasn't been trained on particularly Australian accents as far as I'm aware. I believe it's mostly open source speech datasets, though I admit to not knowing all the details. Model details are here.