Upgrade offline chat model support. Default to Llama 3.1

khoj-ai / khoj

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (e.g gpt, claude, gemini, llama, qwen, mistral).

https://khoj.dev

GNU Affero General Public License v3.0

16.2k stars 796 forks source link

Upgrade offline chat model support. Default to Llama 3.1 #892

Closed debanjum closed 3 months ago

debanjum commented 3 months ago

Upgrade default offline chat model to llama 3.1
Unwrap any json in md code block, when parsing chat actor responses. Improves handling responses by Gemma 2 2B
Break long links in train of thought to stay within chat page width