how to use local ai model?

dave1010 / clipea

📎🟢 Like Clippy but for the CLI. A blazing fast AI helper for your command line

MIT License

302 stars 11 forks source link

how to use local ai model? #41

Open pu-007 opened 5 months ago

pu-007 commented 5 months ago

I tried to install the llm-gpt4all plugin, set orca-mini-3b-gguf2-q4_0 as the default model, as well as write 'orca-mini-3b-gguf2-q4_0' to ~/.config/clipea/clipea_default_model.txt.

However, when I run clipea ..., it returns 'Unknown model: orca-mini-3b-gguf2-q4_0', and it still asks me for a Oenai's API key.

How can I use a local model instead of Openai's service?

pu-007 commented 5 months ago

I just found https://github.com/TheR1D/shell_gpt can do it like this