search

khoj-ai / khoj

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (e.g gpt, claude, gemini, llama, qwen, mistral).
https://khoj.dev
GNU Affero General Public License v3.0
14.11k stars 703 forks source link

[FIX] No Local AI connection (tried, llama.cpp OR ollama) #796

Closed jppaolim closed 1 month ago

jppaolim commented 5 months ago

Describe the bug

After following tutorial, configuring everything, chat in Khoj client doesn't return any answer.

To Reproduce

Mac Os Sonoma 14,5 Download docker docker-compose up download client configure ollama (for instance) or lm studio start a chat try with some documents indexed, but it doesn't change

Screenshots

see below

Platform

If self-hosted

server-1 | [22:58:47.450854] DEBUG uvicorn.error: = connection is protocol.py:256 server-1 | CONNECTING
server-1 | [22:58:47.456446] DEBUG uvicorn.error: < GET server.py:286 server-1 | /api/chat/ws?conversation_id=3&region=%
server-1 | (MASKED IN THIS COPY / PASTE)
server-1 | HTTP/1.1
server-1 | [22:58:47.460393] DEBUG uvicorn.error: < host: localhost:42110 server.py:288 server-1 | [22:58:47.463016] DEBUG uvicorn.error: < connection: Upgrade server.py:288 server-1 | [22:58:47.464992] DEBUG uvicorn.error: < pragma: no-cache server.py:288 server-1 | [22:58:47.467932] DEBUG uvicorn.error: < cache-control: server.py:288 server-1 | no-cache
server-1 | [22:58:47.471291] DEBUG uvicorn.error: < user-agent: server.py:288 server-1 | Mozilla/5.0 (Macintosh; Intel Mac OS X
server-1 | 10_15_7) AppleWebKit/537.36 (KHTML,
server-1 | like Gecko) Chrome/125.0.0.0
server-1 | Safari/537.36
server-1 | [22:58:47.472692] DEBUG uvicorn.error: < upgrade: websocket server.py:288 server-1 | [22:58:47.473238] DEBUG uvicorn.error: < origin: server.py:288 server-1 | http://localhost:42110
server-1 | [22:58:47.473793] DEBUG uvicorn.error: < sec-websocket-version: server.py:288 server-1 | 13
server-1 | [22:58:47.474464] DEBUG uvicorn.error: < accept-encoding: gzip, server.py:288 server-1 | deflate, br, zstd
server-1 | [22:58:47.475405] DEBUG uvicorn.error: < accept-language: server.py:288 server-1 | fr-FR,fr;q=0.9,en-US;q=0.8,en;q=0.7
server-1 | [22:58:47.476124] DEBUG uvicorn.error: < cookie: server.py:288 server-1 | csrftoken=TcD5N3o51EGyvKLxSFLHXnvkVLGaF
server-1 | BWV;
server-1 | sessionid=mnu5v0bhf8puv3u78pdo35tggxw9c
server-1 | hgo
server-1 | [22:58:47.476859] DEBUG uvicorn.error: < sec-websocket-key: server.py:288 server-1 | u9XGbbzjoruqiKTC8t9wJA==
server-1 | [22:58:47.477413] DEBUG uvicorn.error: < server.py:288 server-1 | sec-websocket-extensions:
server-1 | permessage-deflate;
server-1 | client_max_window_bits
server-1 | [22:58:47.487251] INFO uvicorn.error: websockets_impl.py:212 server-1 | ('192.168.65.1', 58271) -
server-1 | "WebSocket /api/chat/ws"
server-1 | [accepted]
server-1 | [22:58:47.488508] DEBUG uvicorn.error: > HTTP/1.1 101 Switching server.py:307 server-1 | Protocols
server-1 | [22:58:47.489475] DEBUG uvicorn.error: > Upgrade: websocket server.py:309 server-1 | [22:58:47.490193] DEBUG uvicorn.error: > Connection: Upgrade server.py:309 server-1 | [22:58:47.490789] DEBUG uvicorn.error: > Sec-WebSocket-Accept: server.py:309 server-1 | hr5cJdI0NeonOqpcezc78EtUmrs=
server-1 | [22:58:47.491398] DEBUG uvicorn.error: > server.py:309 server-1 | Sec-WebSocket-Extensions:
server-1 | permessage-deflate
server-1 | [22:58:47.491981] DEBUG uvicorn.error: > Date: Mon, 03 Jun 2024 server.py:309 server-1 | 22:58:47 GMT
server-1 | [22:58:47.492822] DEBUG uvicorn.error: > Server: Python/3.10 server.py:309 server-1 | websockets/12.0
server-1 | [22:58:47.493497] INFO uvicorn.error: connection open server.py:642 server-1 | [22:58:47.494049] DEBUG uvicorn.error: = connection is OPEN protocol.py:357 server-1 | [22:58:53.316138] INFO uvicorn.access: httptools_impl.py:437 server-1 | 192.168.65.1:58266 - "GET
server-1 | /config HTTP/1.1" 200
server-1 | [22:58:53.331505] DEBUG uvicorn.error: < CLOSE 1001 (going protocol.py:1172 server-1 | away) [2 bytes]
server-1 | [22:58:53.332910] DEBUG uvicorn.error: = connection is protocol.py:1227 server-1 | CLOSING
server-1 | [22:58:53.333710] DEBUG uvicorn.error: > CLOSE 1001 (going protocol.py:1178 server-1 | away) [2 bytes]
server-1 | [22:58:53.334781] DEBUG uvicorn.error: x half-closing TCP protocol.py:1319 server-1 | connection
server-1 | [22:58:53.335572] DEBUG uvicorn.error: = connection is protocol.py:1497 server-1 | CLOSED
server-1 | [22:58:53.337237] DEBUG khoj.routers.api_chat: User default api_chat.py:491 server-1 | disconnected web socket
server-1 | [22:58:53.338838] INFO uvicorn.error: connection closed server.py:264

sabaimran commented 1 month ago

Hi @jppaolim ! We've changed a lot of our code / server since the time this issue was originally posted. Sorry we didn't get to you sooner, but it should likely be addressed.