Integrate Generative AI through KeyboardGPT

Mino260806 commented 3 months ago

Is your feature request related to a problem? Please describe. Generative AI is today a must have feature

Describe the solution you'd like KeyboardGPT is a mod lets you integrate Generative AI in any keyboard.

Demo Video

https://github.com/user-attachments/assets/d00d362d-078f-4d8f-8b17-1544fb62cb37

If you agree with the idea, I can extract the logical part of the module to a java dependency, and we can wire it up with Heliboard. Minimal code changes are to be added to Heliboard:

adding a simple EditText for inputting the prompts and commands
declaring KeyboardGPT overlay activity in AndroidManifest.xml (the activity is for configuration and can may be extended to handle some commands)
everything else would be handled by KeyboardGPT!

I only see advantages to this suggestion because:

Minimal code changes to Heliboard are needed as stated above (I will take care of everything in a PR)
KeyboardGPT code is open source and very small, as it only relies on dependencies for using official language models APIs (these would take some work to remove if you don't want to include them, but it's possible)

Use case It would bring translation, search and customized assistance to the keyboard all through generative AI, I'm also planning to add custom commands like google search, but they are optional if you only want to add generative AI.

Disclaimer: I'm the developer of KeyboardGPT

singhh9596 commented 3 months ago

Sounds useful but it'll take away the key point of the app i.e "completely offline"

Mino260806 commented 3 months ago

Sounds useful but it'll take away the key point of the app i.e "completely offline"

It would be an optional feature, isn't that ok?

wyntrson commented 3 months ago

Sounds useful but it'll take away the key point of the app i.e "completely offline"

It would be an optional feature, isn't that ok?

There is something better for you. Futo voice to text engine, completely open source, and offline, even more accurate and with a better design. In the settings you can change the trained model to super accurate or balanced or fast.

MerkuR-92 commented 3 months ago

Being able to do translations with a lightweight language model (or content summaries) would be next-level for HeliBoard.

Helium314 / HeliBoard

Integrate Generative AI through KeyboardGPT #1012