local Ollama models - Githubissues

gregriff / gpt-cli

Frontend to OpenAI and Anthropic's LLM APIs with Markdown formatting. Focus on simplicity, extensibility and customizability.

MIT License

4 stars 0 forks source link

Open gregriff opened 6 months ago

gregriff commented 6 months ago

Ollama exposes an Open AI-compatible API for local models. Add code to:

GET all models exposed by ollama API at startup (before arg parsing), append these to valid models
add Ollama model LLM subclass, disable price calculation