janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)
https://jan.ai/
GNU Affero General Public License v3.0
23.74k stars 1.38k forks source link

bug: document upload is broken on version 0.5.8 #4023

Closed louis-jan closed 5 days ago

louis-jan commented 1 week ago

Jan version

0.5.8

Describe the Bug

When uploading document, I don't see any request was made on /embeddings endpoint. After that, the app stuck at generating response.

After investigation, the root cause is that the Assistant Extension is outdated with the latest Cortex endpoints. There was a configuration that routed to an old Nitro instance.

See timeWeightedVectorStore configs which are hard coded

Screenshot 2024-11-15 at 10 52 15

Steps to Reproduce

  1. Start a new chat
  2. Upload a pdf document
  3. See the error

Screenshots / Logs

image

Proposed solution

Future enhancement

What is your OS?

imtuyethan commented 5 days ago

Can upload now, though the responses were rubbish, but that's another separate issue.