search

rubberduck-ai / rubberduck-vscode

Use AI-powered code edits, explanations, code generation, error diagnosis, and chat in Visual Studio Code with the official OpenAI API.
https://marketplace.visualstudio.com/items?itemName=Rubberduck.rubberduck-vscode
MIT License
602 stars 75 forks source link

Local Custom Models #112

Open sfxworks opened 10 months ago

sfxworks commented 10 months ago

image

Models is currently enum without the ability to set a custom model name

I am running a local-ai deployment that I'd like to be able to specify custom models for. I have deepseek-coder running via a compatible openai endpoint.

Currently I have to rename the coder model to gpt-4 but id like it if I could just add custom models here like that and wizard-coder.

trymeouteh commented 6 months ago

Privy, which is a fork of Rubberduck supports Ollama models which would be cool to see in rubberduck