search

Adriankhl / godot-llm

LLM in Godot
MIT License
100 stars 3 forks source link

godot-llm enhancements #1

Open fire opened 2 months ago

fire commented 2 months ago

We also made something based on ggml. https://github.com/V-Sekai/v-sekai.whisper We were able to add opencl acceleration and build for multiple platforms.

Thanks to @Ughuuu

Do you want us to send help?

Ughuuu commented 2 months ago

Hey, @fire , you commented! Also send him if possible to our discord or something, might make communication easier.

fire commented 2 months ago

Here's our discord. https://discord.gg/H3s3PD49XC

Ughuuu commented 2 months ago

What I did for whisper addon is basically github action files, mac signing, loading models, etc. not much and could be reused maybe.

Adriankhl commented 2 months ago

Just joined the disord. Currently, this plugin uses vulkan as the backend, so in principle this should be relatively easy to port it for Mac. However, I don't have a Mac myself and I have no knowledge about Mac, it would already be very helpful someone could offer help for mac build and signing.

I am also planning to work on github action build automation once I added more essential features to the plugin.

fire commented 2 months ago

Awesome about the vulkan integration. We did metal integration once, maybe it'll be easy this time too.