When uploading document, I don't see any request was made on /embeddings endpoint. After that, the app stuck at generating response.
After investigation, the root cause is that the Assistant Extension is outdated with the latest Cortex endpoints. There was a configuration that routed to an old Nitro instance.
See timeWeightedVectorStore configs which are hard coded
Steps to Reproduce
Start a new chat
Upload a pdf document
See the error
Screenshots / Logs
Proposed solution
Update configs to match the latest cortex-server instance.
Future enhancement
Run a fixed embedding models such as Nomic by default to serve /embeddings endpoint.
The selected GUI model is for chat operations only.
Jan version
0.5.8
Describe the Bug
When uploading document, I don't see any request was made on /embeddings endpoint. After that, the app stuck at generating response.
After investigation, the root cause is that the Assistant Extension is outdated with the latest Cortex endpoints. There was a configuration that routed to an old Nitro instance.
See
timeWeightedVectorStore
configs which are hard codedSteps to Reproduce
Screenshots / Logs
Proposed solution
Future enhancement
/embeddings
endpoint.What is your OS?