search

Mintplex-Labs / anything-llm

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.
https://anythingllm.com
MIT License
26.94k stars 2.7k forks source link

[LanceDB] Could not respond to message. #244

Closed anchormath closed 1 year ago

anchormath commented 1 year ago

I'm using the Docker version on a Mac. I disabled all vector db options except VECTOR_DB="lancedb" My documents seem to have been processed successfully. When I try to chat I get the 429 error and don't see any errors in the logs, just SELECT * FROM workspace_documents WHERE workspaceId = 1

Also server/storage/lancedb is empty

timothycarambat commented 1 year ago

They are embedded? Because if they were embedded the lancedb folder would not be empty. The Moderation endpoint is something totally unrelated to if your documents are embedded or not.

anchormath commented 1 year ago

ah, so am I missing a step? I do see the documents that must have been processed by the collector into json chunks, how do I get the embeddings for them?

image
timothycarambat commented 1 year ago

Uploading puts them in one massive folder currently. If you click on the line that says custom documents it will expand to show a ton of files (112!)

And file with a ⚡ means it has been embedded before. Red means it is currently embedded and you need to click on the icon to select a whole folder or a specific file.

Very annoying, the whole thing is getting a refresh right now with the V2 UI. But from what I can see it looks like only stuff was uploaded - nothing was embedded yet. That explains the issue!