search

YuriSizov / godot-talk-to-ducky

A silly plugin to help you solve the most impossible of problems with your projects!
MIT License
23 stars 0 forks source link

Make Ducky talk! #1

Open Structed opened 1 year ago

Structed commented 1 year ago

It's a bit lonely. We could implement STT (Speech-to-text) and interface with ChatGPT, which is then converted to TTS to give Ducky a voice!

Arnklit commented 1 year ago

I think that could be fun, but to be honest I'm not a huge fan of how ChatGPT is hiding it's sources and spitting out source code to people, there really isn't any way to know whether you are breaking licenses using it. I'd love if there was an AI model that you actually knew was only trained on Public Domain and / or citet it's sources.

But yeah I'm not really a proper co-creator on this thing, I just made the duck model. Definitely more up to what Yuri thinks of it :).

realkotob commented 1 year ago

I think it would be cool as a start to simplify the functionality here.

We can still make it listen to the developer talking using the microphone api, but it would only respond to a few commands (keyword spotting) which is MUCH easier to implement and there are a lot of open source datasets that can help with this.

So one possibility basically is it would listen to "Hey Ducky!" and then it would nod its head every time it detects any audio input, and you can stop it from listening by saying "What do you think?" and it will just do some quack noises and become idle/inactive again until summoned. (Can also turn itself off and do noises when the audio input goes below a specific db level for a few seconds)

Structed commented 1 year ago

I like this! And how a just-for-fun-issue turns into something!