khoj-ai / khoj

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (e.g gpt, claude, gemini, llama, qwen, mistral).
https://khoj.dev
GNU Affero General Public License v3.0
14.16k stars 705 forks source link

Allow directly reading web pages, even when SERP not enabled #676

Closed debanjum closed 7 months ago

debanjum commented 8 months ago

Overview

Khoj can now read website directly without needing to go through the search step first.

Details

9974d031 Parallelize simple webpage read and extractor 81faa026 Rename extract_content online results field to web pages 50d77906 Tweak prompts to extract information from webpages, online results 83fc7d0d Test select webpage as data source and extract web urls chat actors

384db4ce Render webpage read in chat response references on Web, Desktop apps 0f9c7ede Pass multiple webpages with their urls in online results context

28d1afb1 Support webpage command in chat API f8c23caa Add webpage chat command for read web pages requested by user 6118d1ff Create chat actor for directly reading webpages based on user message