khoj-ai / khoj

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (e.g gpt, claude, gemini, llama, qwen, mistral).
https://khoj.dev
GNU Affero General Public License v3.0
15.9k stars 785 forks source link

Research Mode: Give Khoj the ability to perform more advanced reasoning #952

Closed sabaimran closed 3 weeks ago

sabaimran commented 3 weeks ago

Overview

Khoj can now go into research mode and use a python code interpreter. These are experimental features that are being released early for feedback and testing.

Analysis

Research mode (significantly?) improves Khoj's information retrieval for more complex queries requiring multi-step lookups but takes longer to run. It can research for longer, requiring less back-n-forth with the user to find an answer.

Research mode gives most gains when used with more advanced chat models (like o1, 4o, new claude sonnet and gemini-pro-002). Smaller models improve their response quality but tend to get into repetitive loops more often.

Next Steps

Miscellaneous Improvements