search

minosvasilias / godot-copilot

AI-assisted development for the Godot engine.
MIT License
224 stars 16 forks source link

It would be cool if one could access self-hosted generative models (Llama, WizardLLM, etc.) #15

Open darkhog opened 5 months ago

darkhog commented 5 months ago

Either over the network via Llamacpp/Kobold AI interfaces or running locally on your machine.

With the subscription prices being as they are, hosting your own model can be cheaper.

Efoi commented 5 months ago

I've forked it and added some of that functionality. Its not complete, so I'm not making a PR for it yet, and I'm not sure he wants the changes :P

jjhaggar commented 4 months ago

It'd be great if we could host and run our own models with Ollama (https://github.com/ollama/ollama). They also host lots of models (https://ollama.com/library), it would be great if they would have a finetuned model for Godot 4.x code generation ^^

@minosvasilias I have just seen that you have several Godot code finetunes from about a year ago! :D Would you recommend them over newer models like LLaMA 3? Are you planning on finetuning any of the recently launched models? (and maybe adding it to the Ollama model library?) I'm somewhat baffled that the official Godot devs aren't supporting this initiative more actively ^^U By lowering the entrance barrier and enabling more people to code in Godot, we could all benefit!

darkhog commented 4 months ago

I've forked it and added some of that functionality. Its not complete, so I'm not making a PR for it yet, and I'm not sure he wants the changes :P

That's amazing @Efoi! Will follow and star your fork - even if the PR won't be accepted here, I'll just use the fork.