micr0-dev / lexido

A terminal assistant, powered by Generative AI
GNU Affero General Public License v3.0
218 stars 8 forks source link

Local LLMs via Ollama #44

Closed micr0-dev closed 4 months ago

micr0-dev commented 4 months ago

Allows for local LLMs via Ollama

List of all available LLMs: https://ollama.com/library

Personally I find that the local LLMs are faster but not as knowledgable as Gemini, I have not tried the very large llama models however like 13B and 70B