[FIX] text doesn't generate after local inference completes request

khoj-ai / khoj

Your AI second brain. Get answers to your questions, whether they be online or in your own notes. Use online AI models (e.g gpt4) or private, local LLMs (e.g llama3). Self-host locally or use our cloud instance. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp.

https://khoj.dev

GNU Affero General Public License v3.0

12.63k stars 640 forks source link

[FIX] text doesn't generate after local inference completes request #807

Open thistleknot opened 3 months ago

thistleknot commented 3 months ago

Describe the bug

A clear and concise description of what the bug is. Please include what you were expecting to happen vs. what actually happened.

To Reproduce

Using docker

logged in on server (via xrdp) hosting the docker container

Screenshots

Platform

Server:
- [x] Self-Hosted Docker
Client: direct
OS:
- [x] Linux

If self-hosted

Server Version [e.g. 1.0.1]: commit 8cdab5f31a78cc368b90b1a29f3289942d5ded2a

Additional context

Add any other context about the problem here.

debanjum commented 3 months ago

Hey @thistleknot, can you share server logs as well when you see this behavior? It may contain the error thrown on the server side while processing the request, which will be helpful to debug the issue