search

ricklamers / shell-ai

LangChain powered shell command generator and runner CLI
MIT License
1.02k stars 62 forks source link

Feature request: Local LLM Support #19

Closed illnesse closed 1 year ago

illnesse commented 1 year ago

How is this even a thing without local LLM support? 🥲 I love the idea but it's sadly not an option for me if i can't run it 100% locally.

Maybe via text-generation-webui API for starters

ricklamers commented 1 year ago

You can use local LLMs using OPENAI_API_BASE with OpenAI compatible local LLM APIs like https://lmstudio.ai/