Remote inference - Githubissues

caiobd / sprite-ai

Sprite AI - An AI companion for your desktop

10 stars 3 forks source link

Closed caiobd closed 10 months ago

caiobd commented 10 months ago

Added option to use remote LLM providers

Added Together AI API inference
Added OpenAI API inference
Changed default model to Openchat-1210 in local inference
Added YAML config file for choosing LLM provider, model and customizing inference