Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (e.g gpt, claude, gemini, llama, qwen, mistral).
Khoj wil be able to do online search out of the box, even for self-hosted users
Default to Jina search, reader API when no Serper.dev, Olostep API keys
Run online searches in parallel to process multiple queries faster
Details
Jina provides a reader API for online search and web page reading.
It requires no API key. This provides a good default to enable
online search for self-hosted readers requiring no additional setup.
Jina search API also returns webpage contents with the results, so
just use those directly when Jina Search API used instead of
trying to read webpages separately. The extract relvant content from
webpage step using a chat model is still used from the
read_webpage_and_extract_content func in this case.
Parse search results from Jina search API into same format as
Serper.dev for accurate rendering of online references by clients
Run online searches in parallel with AsyncIO to process multiple
queries faster
Overview
Khoj wil be able to do online search out of the box, even for self-hosted users
Details
Jina provides a reader API for online search and web page reading. It requires no API key. This provides a good default to enable online search for self-hosted readers requiring no additional setup.
Jina search API also returns webpage contents with the results, so just use those directly when Jina Search API used instead of trying to read webpages separately. The extract relvant content from webpage step using a chat model is still used from the
read_webpage_and_extract_contentfunc in this case.Parse search results from Jina search API into same format as Serper.dev for accurate rendering of online references by clients
Run online searches in parallel with AsyncIO to process multiple queries faster