khoj-ai / khoj

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (e.g gpt, claude, gemini, llama, qwen, mistral).
https://khoj.dev
GNU Affero General Public License v3.0
14.7k stars 729 forks source link

Simplify switching chat model when self-hosting #934

Closed debanjum closed 1 month ago

debanjum commented 1 month ago

Overview

Details

This change simplifies switching chat models for self-hosted setups by just changing the chat model on the user settings page.

It falls back to use the user chat model for train of thought if server chat settings have not been created on the admin panel.

Server chat settings, when set, controls the chat model used for Khoj's train of thought and the default user chat model.

Previously a self-hosted user had to update

  1. the server chat settings in the admin panel and
  2. their own user chat model in the user settings panel

to completely switch to a different chat model for both train of thought & response generation respectively

You can still set server chat settings via the admin panel to use a different chat model for train of thought vs response generation. But this is only useful for advanced, multi-user setups.