search

Mintplex-Labs / anything-llm

The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.
https://anythingllm.com
MIT License
27.48k stars 2.77k forks source link

[BUG]: ChromaDB failed to upload document but does successfully on backend #2536

Open siver1152 opened 4 weeks ago

siver1152 commented 4 weeks ago

How are you running AnythingLLM?

AnythingLLM desktop app

What happened?

I updated to v1.6.8 and didn’t experience this issue until now, after updating. I’m running a local instance of ChromaDB and have tried this on both an older version and the latest version (as of this post). There is an issue with uploading documents via the channel. When trying to upload, I get this error:

image

Here is what I see on the ChromaDB log after first attempted uploaded:

image image

It appears that after uploading, AnythingLLM doesn’t register that it’s been uploaded. When I ask a question regarding this, it does provide information on the document. I tested this in a channel that didn’t have the document uploaded, and I can confirm it’s not recognized in a new channel (to be expected).

When asking questions with the document uploaded, here is what I’m seeing in the AnythingLLM response (normal response) side

image

Here is the section where it shows what’s uploaded: image

ChromaDB logs after asking a question about the document: image

Vector Database Section in channel settings after file upload failed: image

One thing I figured out as well is that if you upload the document via the prompt bar, it will successfully embed it the first time.

I tried it again a second time, and now the file won’t upload to the channel with or without the prior upload of the file. It will not work with new files either, even after resetting the chat history.

Upon resetting VectorDB in the channel settings and uploading the file afterward, it works. image

chroma logs after reset and question:

image

Here are all the logs from fresh install of latest chromaDB:

2024-10-25 12:54:23 Starting 'uvicorn chromadb.app:app' with args: --workers 1 --host 0.0.0.0 --port 8000 --proxy-headers --log-config chromadb/log_config.yml --timeout-keep-alive 30 2024-10-25 12:54:25 WARNING: [25-10-2024 17:54:25] chroma_server_nofile is set to 65536, but this is less than current soft limit of 1048576. chroma_server_nofile will not be set. 2024-10-25 12:54:25 DEBUG: [25-10-2024 17:54:25] Starting component System 2024-10-25 12:54:25 DEBUG: [25-10-2024 17:54:25] Starting component OpenTelemetryClient 2024-10-25 12:54:25 DEBUG: [25-10-2024 17:54:25] Starting component SqliteDB 2024-10-25 12:54:25 DEBUG: [25-10-2024 17:54:25] Starting component QuotaEnforcer 2024-10-25 12:54:25 DEBUG: [25-10-2024 17:54:25] Starting component Posthog 2024-10-25 12:54:25 DEBUG: [25-10-2024 17:54:25] Starting component SimpleRateLimitEnforcer 2024-10-25 12:54:25 DEBUG: [25-10-2024 17:54:25] Starting component LocalSegmentManager 2024-10-25 12:54:25 DEBUG: [25-10-2024 17:54:25] Starting component LocalExecutor 2024-10-25 12:54:25 DEBUG: [25-10-2024 17:54:25] Starting component SegmentAPI 2024-10-25 12:54:25 INFO: [25-10-2024 17:54:25] Started server process [1] 2024-10-25 12:54:25 INFO: [25-10-2024 17:54:25] Waiting for application startup. 2024-10-25 12:54:25 INFO: [25-10-2024 17:54:25] Application startup complete. 2024-10-25 12:54:25 INFO: [25-10-2024 17:54:25] Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) 2024-10-25 12:54:35 INFO: [25-10-2024 17:54:35] 172.17.0.1:56466 - "GET /api/v1 HTTP/1.1" 200 2024-10-25 12:54:35 INFO: [25-10-2024 17:54:35] 172.17.0.1:56472 - "GET / HTTP/1.1" 404 2024-10-25 12:54:35 INFO: [25-10-2024 17:54:35] 172.17.0.1:56466 - "GET /favicon.ico HTTP/1.1" 404 2024-10-25 12:54:46 INFO: [25-10-2024 17:54:46] 172.17.0.1:56466 - "GET / HTTP/1.1" 404 2024-10-25 12:54:46 INFO: [25-10-2024 17:54:46] 172.17.0.1:56472 - "GET / HTTP/1.1" 404 2024-10-25 12:55:28 INFO: [25-10-2024 17:55:28] 172.17.0.1:52382 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 12:55:28 INFO: [25-10-2024 17:55:28] 172.17.0.1:52382 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 12:55:28 INFO: [25-10-2024 17:55:28] 172.17.0.1:52382 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 12:55:28 INFO: [25-10-2024 17:55:28] 172.17.0.1:52382 - "GET /api/v1/collections/test1?tenant=default_tenant&database=default_database HTTP/1.1" 400 2024-10-25 12:56:12 INFO: [25-10-2024 17:56:12] 172.17.0.1:55676 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 12:56:12 INFO: [25-10-2024 17:56:12] 172.17.0.1:55676 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 12:56:12 INFO: [25-10-2024 17:56:12] 172.17.0.1:55676 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 12:56:12 INFO: [25-10-2024 17:56:12] 172.17.0.1:55676 - "POST /api/v1/collections?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 12:56:12 DEBUG: [25-10-2024 17:56:12] Starting component PersistentLocalHnswSegment 2024-10-25 12:56:12 INFO: [25-10-2024 17:56:12] 172.17.0.1:55676 - "POST /api/v1/collections/74c08a10-88d5-4ea5-8161-fc41991bd040/add HTTP/1.1" 201 2024-10-25 13:02:27 INFO: [25-10-2024 18:02:27] 172.17.0.1:58222 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:02:27 INFO: [25-10-2024 18:02:27] 172.17.0.1:58222 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:02:27 INFO: [25-10-2024 18:02:27] 172.17.0.1:58222 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:02:27 DEBUG: [25-10-2024 18:02:27] Collection test1 already exists, returning existing collection. 2024-10-25 13:02:27 INFO: [25-10-2024 18:02:27] 172.17.0.1:58222 - "POST /api/v1/collections?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:02:27 INFO: [25-10-2024 18:02:27] 172.17.0.1:58222 - "POST /api/v1/collections/74c08a10-88d5-4ea5-8161-fc41991bd040/add HTTP/1.1" 201 2024-10-25 13:03:47 INFO: [25-10-2024 18:03:47] 172.17.0.1:51062 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:03:47 INFO: [25-10-2024 18:03:47] 172.17.0.1:51062 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:03:47 INFO: [25-10-2024 18:03:47] 172.17.0.1:51062 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:03:47 DEBUG: [25-10-2024 18:03:47] Collection test1 already exists, returning existing collection. 2024-10-25 13:03:48 INFO: [25-10-2024 18:03:48] 172.17.0.1:51062 - "POST /api/v1/collections?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:03:48 INFO: [25-10-2024 18:03:48] 172.17.0.1:51062 - "POST /api/v1/collections/74c08a10-88d5-4ea5-8161-fc41991bd040/add HTTP/1.1" 201 2024-10-25 13:04:23 INFO: [25-10-2024 18:04:23] 172.17.0.1:43714 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:04:23 INFO: [25-10-2024 18:04:23] 172.17.0.1:43714 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:04:23 INFO: [25-10-2024 18:04:23] 172.17.0.1:43714 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:04:23 DEBUG: [25-10-2024 18:04:23] Collection test1 already exists, returning existing collection. 2024-10-25 13:04:23 INFO: [25-10-2024 18:04:23] 172.17.0.1:43714 - "POST /api/v1/collections?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:04:23 INFO: [25-10-2024 18:04:23] 172.17.0.1:43714 - "POST /api/v1/collections/74c08a10-88d5-4ea5-8161-fc41991bd040/add HTTP/1.1" 201 2024-10-25 13:04:32 INFO: [25-10-2024 18:04:32] 172.17.0.1:45470 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:04:32 INFO: [25-10-2024 18:04:32] 172.17.0.1:45470 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:04:32 INFO: [25-10-2024 18:04:32] 172.17.0.1:45470 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:04:32 INFO: [25-10-2024 18:04:32] 172.17.0.1:45470 - "GET /api/v1/collections/test1?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:04:32 INFO: [25-10-2024 18:04:32] 172.17.0.1:45470 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:04:32 INFO: [25-10-2024 18:04:32] 172.17.0.1:45470 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:04:32 INFO: [25-10-2024 18:04:32] 172.17.0.1:45470 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:04:32 INFO: [25-10-2024 18:04:32] 172.17.0.1:45470 - "GET /api/v1/collections/test1?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:04:32 INFO: [25-10-2024 18:04:32] 172.17.0.1:45470 - "GET /api/v1/collections/74c08a10-88d5-4ea5-8161-fc41991bd040/count HTTP/1.1" 200 2024-10-25 13:04:32 INFO: [25-10-2024 18:04:32] 172.17.0.1:45470 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:04:32 INFO: [25-10-2024 18:04:32] 172.17.0.1:45470 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:04:32 INFO: [25-10-2024 18:04:32] 172.17.0.1:45470 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:04:32 INFO: [25-10-2024 18:04:32] 172.17.0.1:45470 - "GET /api/v1/collections/test1?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:04:32 INFO: [25-10-2024 18:04:32] 172.17.0.1:45470 - "GET /api/v1/collections/test1?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:04:32 INFO: [25-10-2024 18:04:32] 172.17.0.1:45470 - "POST /api/v1/collections/74c08a10-88d5-4ea5-8161-fc41991bd040/query HTTP/1.1" 200 2024-10-25 13:22:43 INFO: [25-10-2024 18:22:43] 172.17.0.1:55332 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:22:43 INFO: [25-10-2024 18:22:43] 172.17.0.1:55332 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:22:43 INFO: [25-10-2024 18:22:43] 172.17.0.1:55332 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:22:43 DEBUG: [25-10-2024 18:22:43] Collection test1 already exists, returning existing collection. 2024-10-25 13:22:43 INFO: [25-10-2024 18:22:43] 172.17.0.1:55332 - "POST /api/v1/collections?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:22:43 INFO: [25-10-2024 18:22:43] 172.17.0.1:55332 - "POST /api/v1/collections/74c08a10-88d5-4ea5-8161-fc41991bd040/add HTTP/1.1" 201 2024-10-25 13:23:10 INFO: [25-10-2024 18:23:10] 172.17.0.1:33978 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:23:10 INFO: [25-10-2024 18:23:10] 172.17.0.1:33978 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:23:10 INFO: [25-10-2024 18:23:10] 172.17.0.1:33978 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:23:10 INFO: [25-10-2024 18:23:10] 172.17.0.1:33978 - "POST /api/v1/collections?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:23:10 DEBUG: [25-10-2024 18:23:10] Starting component PersistentLocalHnswSegment 2024-10-25 13:23:10 INFO: [25-10-2024 18:23:10] 172.17.0.1:33978 - "POST /api/v1/collections/52b4f693-f561-4ec5-b222-4ca361e99a2e/add HTTP/1.1" 201 2024-10-25 13:23:27 INFO: [25-10-2024 18:23:27] 172.17.0.1:57114 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:23:27 INFO: [25-10-2024 18:23:27] 172.17.0.1:57114 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:23:27 INFO: [25-10-2024 18:23:27] 172.17.0.1:57114 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:23:27 INFO: [25-10-2024 18:23:27] 172.17.0.1:57114 - "GET /api/v1/collections/test2?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:23:27 INFO: [25-10-2024 18:23:27] 172.17.0.1:57114 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:23:27 INFO: [25-10-2024 18:23:27] 172.17.0.1:57114 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:23:27 INFO: [25-10-2024 18:23:27] 172.17.0.1:57114 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:23:27 INFO: [25-10-2024 18:23:27] 172.17.0.1:57114 - "GET /api/v1/collections/test2?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:23:27 INFO: [25-10-2024 18:23:27] 172.17.0.1:57114 - "GET /api/v1/collections/52b4f693-f561-4ec5-b222-4ca361e99a2e/count HTTP/1.1" 200 2024-10-25 13:23:27 INFO: [25-10-2024 18:23:27] 172.17.0.1:57114 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:23:27 INFO: [25-10-2024 18:23:27] 172.17.0.1:57114 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:23:27 INFO: [25-10-2024 18:23:27] 172.17.0.1:57114 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:23:27 INFO: [25-10-2024 18:23:27] 172.17.0.1:57114 - "GET /api/v1/collections/test2?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:23:27 INFO: [25-10-2024 18:23:27] 172.17.0.1:57114 - "GET /api/v1/collections/test2?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:23:27 WARNING: [25-10-2024 18:23:27] Number of requested results 4 is greater than number of elements in index 2, updating n_results = 2 2024-10-25 13:23:27 INFO: [25-10-2024 18:23:27] 172.17.0.1:57114 - "POST /api/v1/collections/52b4f693-f561-4ec5-b222-4ca361e99a2e/query HTTP/1.1" 200 2024-10-25 13:27:21 INFO: [25-10-2024 18:27:21] 172.17.0.1:51892 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:27:21 INFO: [25-10-2024 18:27:21] 172.17.0.1:51892 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:27:21 INFO: [25-10-2024 18:27:21] 172.17.0.1:51892 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:27:21 INFO: [25-10-2024 18:27:21] 172.17.0.1:51892 - "POST /api/v1/collections?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:27:21 DEBUG: [25-10-2024 18:27:21] Starting component PersistentLocalHnswSegment 2024-10-25 13:27:21 INFO: [25-10-2024 18:27:21] 172.17.0.1:51892 - "POST /api/v1/collections/797317d0-ab76-4841-afa2-e9af3cd94a8c/add HTTP/1.1" 201 2024-10-25 13:27:38 INFO: [25-10-2024 18:27:38] 172.17.0.1:36806 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:27:38 INFO: [25-10-2024 18:27:38] 172.17.0.1:36806 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:27:38 INFO: [25-10-2024 18:27:38] 172.17.0.1:36806 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:27:38 INFO: [25-10-2024 18:27:38] 172.17.0.1:36806 - "GET /api/v1/collections/test3?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:27:38 INFO: [25-10-2024 18:27:38] 172.17.0.1:36806 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:27:38 INFO: [25-10-2024 18:27:38] 172.17.0.1:36806 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:27:38 INFO: [25-10-2024 18:27:38] 172.17.0.1:36806 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:27:38 INFO: [25-10-2024 18:27:38] 172.17.0.1:36806 - "GET /api/v1/collections/test3?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:27:38 INFO: [25-10-2024 18:27:38] 172.17.0.1:36806 - "GET /api/v1/collections/797317d0-ab76-4841-afa2-e9af3cd94a8c/count HTTP/1.1" 200 2024-10-25 13:27:38 INFO: [25-10-2024 18:27:38] 172.17.0.1:36806 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:27:38 INFO: [25-10-2024 18:27:38] 172.17.0.1:36806 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:27:38 INFO: [25-10-2024 18:27:38] 172.17.0.1:36806 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:27:38 INFO: [25-10-2024 18:27:38] 172.17.0.1:36806 - "GET /api/v1/collections/test3?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:27:38 INFO: [25-10-2024 18:27:38] 172.17.0.1:36806 - "GET /api/v1/collections/test3?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:27:38 WARNING: [25-10-2024 18:27:38] Number of requested results 4 is greater than number of elements in index 2, updating n_results = 2 2024-10-25 13:27:38 INFO: [25-10-2024 18:27:38] 172.17.0.1:36806 - "POST /api/v1/collections/797317d0-ab76-4841-afa2-e9af3cd94a8c/query HTTP/1.1" 200 2024-10-25 13:27:57 INFO: [25-10-2024 18:27:57] 172.17.0.1:51624 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:27:57 INFO: [25-10-2024 18:27:57] 172.17.0.1:51624 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:27:57 INFO: [25-10-2024 18:27:57] 172.17.0.1:51624 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:27:57 INFO: [25-10-2024 18:27:57] 172.17.0.1:51624 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 400 2024-10-25 13:27:57 INFO: [25-10-2024 18:27:57] 172.17.0.1:51624 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:27:57 INFO: [25-10-2024 18:27:57] 172.17.0.1:51624 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:27:57 INFO: [25-10-2024 18:27:57] 172.17.0.1:51624 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:27:57 INFO: [25-10-2024 18:27:57] 172.17.0.1:51624 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 400 2024-10-25 13:31:32 INFO: [25-10-2024 18:31:32] 172.17.0.1:54040 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:31:32 INFO: [25-10-2024 18:31:32] 172.17.0.1:54040 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:31:32 INFO: [25-10-2024 18:31:32] 172.17.0.1:54040 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:31:32 DEBUG: [25-10-2024 18:31:32] Collection test2 already exists, returning existing collection. 2024-10-25 13:31:32 INFO: [25-10-2024 18:31:32] 172.17.0.1:54040 - "POST /api/v1/collections?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:31:32 INFO: [25-10-2024 18:31:32] 172.17.0.1:54040 - "POST /api/v1/collections/52b4f693-f561-4ec5-b222-4ca361e99a2e/add HTTP/1.1" 201 2024-10-25 13:32:28 INFO: [25-10-2024 18:32:28] 172.17.0.1:53576 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:32:28 INFO: [25-10-2024 18:32:28] 172.17.0.1:53576 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:32:28 INFO: [25-10-2024 18:32:28] 172.17.0.1:53576 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:32:28 DEBUG: [25-10-2024 18:32:28] Collection test2 already exists, returning existing collection. 2024-10-25 13:32:28 INFO: [25-10-2024 18:32:28] 172.17.0.1:53576 - "POST /api/v1/collections?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:32:28 INFO: [25-10-2024 18:32:28] 172.17.0.1:53576 - "POST /api/v1/collections/52b4f693-f561-4ec5-b222-4ca361e99a2e/add HTTP/1.1" 201 2024-10-25 13:35:05 INFO: [25-10-2024 18:35:05] 172.17.0.1:52450 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:35:05 INFO: [25-10-2024 18:35:05] 172.17.0.1:52450 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:35:05 INFO: [25-10-2024 18:35:05] 172.17.0.1:52450 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:35:05 INFO: [25-10-2024 18:35:05] 172.17.0.1:52450 - "POST /api/v1/collections?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:35:05 DEBUG: [25-10-2024 18:35:05] Starting component PersistentLocalHnswSegment 2024-10-25 13:35:05 INFO: [25-10-2024 18:35:05] 172.17.0.1:52450 - "POST /api/v1/collections/bd83423f-03ef-4d47-8a2d-55b739ad5d1b/add HTTP/1.1" 201 2024-10-25 13:35:25 INFO: [25-10-2024 18:35:25] 172.17.0.1:36050 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:35:25 INFO: [25-10-2024 18:35:25] 172.17.0.1:36050 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:35:25 INFO: [25-10-2024 18:35:25] 172.17.0.1:36050 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:35:25 INFO: [25-10-2024 18:35:25] 172.17.0.1:36050 - "GET /api/v1/collections/test3?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:35:25 INFO: [25-10-2024 18:35:25] 172.17.0.1:36050 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:35:25 INFO: [25-10-2024 18:35:25] 172.17.0.1:36050 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:35:25 INFO: [25-10-2024 18:35:25] 172.17.0.1:36050 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:35:25 INFO: [25-10-2024 18:35:25] 172.17.0.1:36050 - "GET /api/v1/collections/test3?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:35:25 INFO: [25-10-2024 18:35:25] 172.17.0.1:36050 - "GET /api/v1/collections/797317d0-ab76-4841-afa2-e9af3cd94a8c/count HTTP/1.1" 200 2024-10-25 13:35:25 INFO: [25-10-2024 18:35:25] 172.17.0.1:36050 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:35:25 INFO: [25-10-2024 18:35:25] 172.17.0.1:36050 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:35:25 INFO: [25-10-2024 18:35:25] 172.17.0.1:36050 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:35:25 INFO: [25-10-2024 18:35:25] 172.17.0.1:36050 - "GET /api/v1/collections/test3?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:35:25 INFO: [25-10-2024 18:35:25] 172.17.0.1:36050 - "GET /api/v1/collections/test3?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:35:25 WARNING: [25-10-2024 18:35:25] Number of requested results 4 is greater than number of elements in index 2, updating n_results = 2 2024-10-25 13:35:25 INFO: [25-10-2024 18:35:25] 172.17.0.1:36050 - "POST /api/v1/collections/797317d0-ab76-4841-afa2-e9af3cd94a8c/query HTTP/1.1" 200 2024-10-25 13:45:02 INFO: [25-10-2024 18:45:02] 172.17.0.1:41542 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:45:02 INFO: [25-10-2024 18:45:02] 172.17.0.1:41542 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:45:02 INFO: [25-10-2024 18:45:02] 172.17.0.1:41542 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:45:02 INFO: [25-10-2024 18:45:02] 172.17.0.1:41542 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:45:02 INFO: [25-10-2024 18:45:02] 172.17.0.1:41542 - "GET /api/v1/collections/bd83423f-03ef-4d47-8a2d-55b739ad5d1b/count HTTP/1.1" 200 2024-10-25 13:45:09 INFO: [25-10-2024 18:45:09] 172.17.0.1:43278 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:45:09 INFO: [25-10-2024 18:45:09] 172.17.0.1:43278 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:45:09 INFO: [25-10-2024 18:45:09] 172.17.0.1:43278 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:45:09 INFO: [25-10-2024 18:45:09] 172.17.0.1:43278 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:45:09 INFO: [25-10-2024 18:45:09] 172.17.0.1:43278 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:45:09 INFO: [25-10-2024 18:45:09] 172.17.0.1:43278 - "GET /api/v1/collections/bd83423f-03ef-4d47-8a2d-55b739ad5d1b/count HTTP/1.1" 200 2024-10-25 13:45:10 INFO: [25-10-2024 18:45:10] 172.17.0.1:43278 - "DELETE /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:45:20 INFO: [25-10-2024 18:45:20] 172.17.0.1:35486 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:45:20 INFO: [25-10-2024 18:45:20] 172.17.0.1:35486 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:45:20 INFO: [25-10-2024 18:45:20] 172.17.0.1:35486 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:45:20 INFO: [25-10-2024 18:45:20] 172.17.0.1:35486 - "POST /api/v1/collections?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:45:20 DEBUG: [25-10-2024 18:45:20] Starting component PersistentLocalHnswSegment 2024-10-25 13:45:20 INFO: [25-10-2024 18:45:20] 172.17.0.1:35486 - "POST /api/v1/collections/9f3ec578-738e-4ea6-9744-5d4c5ed22d41/add HTTP/1.1" 201 2024-10-25 13:49:37 INFO: [25-10-2024 18:49:37] 172.17.0.1:50144 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:49:37 INFO: [25-10-2024 18:49:37] 172.17.0.1:50144 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:49:37 INFO: [25-10-2024 18:49:37] 172.17.0.1:50144 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:49:37 INFO: [25-10-2024 18:49:37] 172.17.0.1:50144 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:49:37 INFO: [25-10-2024 18:49:37] 172.17.0.1:50144 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:49:37 INFO: [25-10-2024 18:49:37] 172.17.0.1:50144 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:49:37 INFO: [25-10-2024 18:49:37] 172.17.0.1:50144 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:49:37 INFO: [25-10-2024 18:49:37] 172.17.0.1:50144 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:49:37 INFO: [25-10-2024 18:49:37] 172.17.0.1:50144 - "GET /api/v1/collections/9f3ec578-738e-4ea6-9744-5d4c5ed22d41/count HTTP/1.1" 200 2024-10-25 13:49:37 INFO: [25-10-2024 18:49:37] 172.17.0.1:50144 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:49:37 INFO: [25-10-2024 18:49:37] 172.17.0.1:50144 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:49:37 INFO: [25-10-2024 18:49:37] 172.17.0.1:50144 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:49:37 INFO: [25-10-2024 18:49:37] 172.17.0.1:50144 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:49:37 INFO: [25-10-2024 18:49:37] 172.17.0.1:50144 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:49:37 WARNING: [25-10-2024 18:49:37] Number of requested results 4 is greater than number of elements in index 2, updating n_results = 2 2024-10-25 13:49:37 INFO: [25-10-2024 18:49:37] 172.17.0.1:50144 - "POST /api/v1/collections/9f3ec578-738e-4ea6-9744-5d4c5ed22d41/query HTTP/1.1" 200 2024-10-25 13:51:31 INFO: [25-10-2024 18:51:31] 172.17.0.1:41804 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:51:31 INFO: [25-10-2024 18:51:31] 172.17.0.1:41804 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:51:31 INFO: [25-10-2024 18:51:31] 172.17.0.1:41804 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:51:31 INFO: [25-10-2024 18:51:31] 172.17.0.1:41804 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:51:31 INFO: [25-10-2024 18:51:31] 172.17.0.1:41804 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:51:31 INFO: [25-10-2024 18:51:31] 172.17.0.1:41804 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:51:31 INFO: [25-10-2024 18:51:31] 172.17.0.1:41804 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:51:31 INFO: [25-10-2024 18:51:31] 172.17.0.1:41804 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:51:31 INFO: [25-10-2024 18:51:31] 172.17.0.1:41804 - "GET /api/v1/collections/9f3ec578-738e-4ea6-9744-5d4c5ed22d41/count HTTP/1.1" 200 2024-10-25 13:51:31 INFO: [25-10-2024 18:51:31] 172.17.0.1:41804 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:51:31 INFO: [25-10-2024 18:51:31] 172.17.0.1:41804 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:51:31 INFO: [25-10-2024 18:51:31] 172.17.0.1:41804 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:51:31 INFO: [25-10-2024 18:51:31] 172.17.0.1:41804 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:51:31 INFO: [25-10-2024 18:51:31] 172.17.0.1:41804 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:51:31 WARNING: [25-10-2024 18:51:31] Number of requested results 4 is greater than number of elements in index 2, updating n_results = 2 2024-10-25 13:51:31 INFO: [25-10-2024 18:51:31] 172.17.0.1:41804 - "POST /api/v1/collections/9f3ec578-738e-4ea6-9744-5d4c5ed22d41/query HTTP/1.1" 200 2024-10-25 13:54:06 INFO: [25-10-2024 18:54:06] 172.17.0.1:43352 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:54:06 INFO: [25-10-2024 18:54:06] 172.17.0.1:43352 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:54:06 INFO: [25-10-2024 18:54:06] 172.17.0.1:43352 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:54:06 INFO: [25-10-2024 18:54:06] 172.17.0.1:43352 - "GET /api/v1/collections/test2?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:54:06 INFO: [25-10-2024 18:54:06] 172.17.0.1:43352 - "GET /api/v1/collections/52b4f693-f561-4ec5-b222-4ca361e99a2e/count HTTP/1.1" 200 2024-10-25 13:54:26 INFO: [25-10-2024 18:54:26] 172.17.0.1:36240 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:54:26 INFO: [25-10-2024 18:54:26] 172.17.0.1:36240 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:54:26 INFO: [25-10-2024 18:54:26] 172.17.0.1:36240 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:54:26 INFO: [25-10-2024 18:54:26] 172.17.0.1:36240 - "GET /api/v1/collections/test1?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:54:26 INFO: [25-10-2024 18:54:26] 172.17.0.1:36240 - "GET /api/v1/collections/74c08a10-88d5-4ea5-8161-fc41991bd040/count HTTP/1.1" 200 2024-10-25 13:56:46 INFO: [25-10-2024 18:56:46] 172.17.0.1:49008 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:56:46 INFO: [25-10-2024 18:56:46] 172.17.0.1:49008 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:56:46 INFO: [25-10-2024 18:56:46] 172.17.0.1:49008 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:56:46 INFO: [25-10-2024 18:56:46] 172.17.0.1:49008 - "GET /api/v1/collections/test3?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:56:46 INFO: [25-10-2024 18:56:46] 172.17.0.1:49008 - "GET /api/v1/collections/797317d0-ab76-4841-afa2-e9af3cd94a8c/count HTTP/1.1" 200 2024-10-25 13:58:40 INFO: [25-10-2024 18:58:40] 172.17.0.1:38396 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:58:40 INFO: [25-10-2024 18:58:40] 172.17.0.1:38396 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:58:40 INFO: [25-10-2024 18:58:40] 172.17.0.1:38396 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:58:40 INFO: [25-10-2024 18:58:40] 172.17.0.1:38396 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:58:40 INFO: [25-10-2024 18:58:40] 172.17.0.1:38396 - "GET /api/v1/collections/9f3ec578-738e-4ea6-9744-5d4c5ed22d41/count HTTP/1.1" 200 2024-10-25 13:58:43 INFO: [25-10-2024 18:58:43] 172.17.0.1:38396 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:58:43 INFO: [25-10-2024 18:58:43] 172.17.0.1:38396 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:58:43 INFO: [25-10-2024 18:58:43] 172.17.0.1:38396 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:58:43 INFO: [25-10-2024 18:58:43] 172.17.0.1:38396 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:58:43 INFO: [25-10-2024 18:58:43] 172.17.0.1:38396 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:58:43 INFO: [25-10-2024 18:58:43] 172.17.0.1:38396 - "GET /api/v1/collections/9f3ec578-738e-4ea6-9744-5d4c5ed22d41/count HTTP/1.1" 200 2024-10-25 13:58:43 INFO: [25-10-2024 18:58:43] 172.17.0.1:38396 - "DELETE /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:58:58 INFO: [25-10-2024 18:58:58] 172.17.0.1:48812 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 13:58:58 INFO: [25-10-2024 18:58:58] 172.17.0.1:48812 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 13:58:58 INFO: [25-10-2024 18:58:58] 172.17.0.1:48812 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 13:58:58 INFO: [25-10-2024 18:58:58] 172.17.0.1:48812 - "POST /api/v1/collections?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 13:58:58 DEBUG: [25-10-2024 18:58:58] Starting component PersistentLocalHnswSegment 2024-10-25 13:58:58 INFO: [25-10-2024 18:58:58] 172.17.0.1:48812 - "POST /api/v1/collections/0531cb41-faca-463c-b8b9-e4ffa86509a9/add HTTP/1.1" 201 2024-10-25 14:07:34 INFO: [25-10-2024 19:07:34] 172.17.0.1:46822 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 14:07:34 INFO: [25-10-2024 19:07:34] 172.17.0.1:46822 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 14:07:34 INFO: [25-10-2024 19:07:34] 172.17.0.1:46822 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 14:07:34 INFO: [25-10-2024 19:07:34] 172.17.0.1:46822 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 14:07:34 INFO: [25-10-2024 19:07:34] 172.17.0.1:46822 - "GET /api/v1/collections/0531cb41-faca-463c-b8b9-e4ffa86509a9/count HTTP/1.1" 200 2024-10-25 14:07:36 INFO: [25-10-2024 19:07:36] 172.17.0.1:46822 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 14:07:36 INFO: [25-10-2024 19:07:36] 172.17.0.1:46822 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 14:07:36 INFO: [25-10-2024 19:07:36] 172.17.0.1:46822 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 14:07:36 INFO: [25-10-2024 19:07:36] 172.17.0.1:46822 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 14:07:36 INFO: [25-10-2024 19:07:36] 172.17.0.1:46822 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 14:07:36 INFO: [25-10-2024 19:07:36] 172.17.0.1:46822 - "GET /api/v1/collections/0531cb41-faca-463c-b8b9-e4ffa86509a9/count HTTP/1.1" 200 2024-10-25 14:07:36 INFO: [25-10-2024 19:07:36] 172.17.0.1:46822 - "DELETE /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 14:07:49 INFO: [25-10-2024 19:07:49] 172.17.0.1:44400 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 14:07:49 INFO: [25-10-2024 19:07:49] 172.17.0.1:44400 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 14:07:49 INFO: [25-10-2024 19:07:49] 172.17.0.1:44400 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 14:07:49 INFO: [25-10-2024 19:07:49] 172.17.0.1:44400 - "POST /api/v1/collections?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 14:07:49 DEBUG: [25-10-2024 19:07:49] Starting component PersistentLocalHnswSegment 2024-10-25 14:07:49 INFO: [25-10-2024 19:07:49] 172.17.0.1:44400 - "POST /api/v1/collections/459cebde-02a9-4e8d-a327-f5ba2f2bd1de/add HTTP/1.1" 201 2024-10-25 14:08:15 INFO: [25-10-2024 19:08:15] 172.17.0.1:48632 - "GET /api/v1/heartbeat HTTP/1.1" 200 2024-10-25 14:08:15 INFO: [25-10-2024 19:08:15] 172.17.0.1:48632 - "GET /api/v1/tenants/default_tenant HTTP/1.1" 200 2024-10-25 14:08:15 INFO: [25-10-2024 19:08:15] 172.17.0.1:48632 - "GET /api/v1/databases/default_database?tenant=default_tenant HTTP/1.1" 200 2024-10-25 14:08:15 INFO: [25-10-2024 19:08:15] 172.17.0.1:48632 - "GET /api/v1/collections/test4?tenant=default_tenant&database=default_database HTTP/1.1" 200 2024-10-25 14:08:15 INFO: [25-10-2024 19:08:15] 172.17.0.1:48632 - "GET /api/v1/collections/459cebde-02a9-4e8d-a327-f5ba2f2bd1de/count HTTP/1.1" 200

hopefully this help. Thank you

Are there known steps to reproduce?

  1. Fresh install of ChromaDB from DockerHub.
  2. Set up normally, forwarding any required ports.
  3. Upload a text document and submit to specific channel. done

Odd behavior for the steps above:

  1. Ask the channel about the document.

Prompt bar upload issue:

  1. Create a new channel.
  2. Upload the document via the prompt bar and ask a question.
  3. Re-upload the same or a different document to the channel or any channel via the prompt bar. done

Fix for prompt bar re-upload issues:

  1. go to channel settings:
  2. go to Vector Database tab.
  3. Reset Vactor Database
  4. Re-upload the document via prompt bar (works in any channel).
timothycarambat commented 3 weeks ago

Are you able to see any logs from AnythingLLM? There must be a failure to upsert log in those logs as well - which could very well be the source or at least an indication of what is wrong.

siver1152 commented 3 weeks ago

Yes, I am. Event Viewer shows that the document is being uploaded successfully and added to the workspace without any issues. It also indicates that the vector database is being updated on AnythingLLM. I'm not sure if the document is being cached on the backend, but regardless, it's showing as working in Event Viewer.

When looking at the debug logs in PowerShell, it shows that the document is being uploaded successfully, which is odd. When I ask a question without calling the agent, it works, as shown in my picture above. However, when calling the RAG-search agent, it fails. Here are all the logs I have. All I’ve done is delete and create a workspace, upload the document (which had a different issue when deleting a document), ask a question, and calling the agent function.

I encountered a new strange issue: when I uploaded the document again, it appeared in the prompt upload bar, which hadn’t happened before, it used to just indicate a failure without showing up there.

Here is what I got from the debug logs start to finish.

Debug logs below:

[OllamaProcessManager] Ollama will bind on port 11434 when booted. [Preferences] Will load window with last know bounds. [backend] info: [EncryptionManager] Loaded existing key & salt for encrypting arbitrary data. [collector] info: Collector hot directory and tmp storage wiped! [collector] info: [production] AnythingLLM Standalone Document processor listening on port 8888. [backend] info: [TELEMETRY DISABLED] Telemetry is marked as disabled - no events will send. Telemetry helps Mintplex Labs Inc improve AnythingLLM. [backend] info: Skipping preloading of AnythingLLMOllama - LLM_PROVIDER is ollama. [backend] info: [CommunicationKey] RSA key pair generated for signed payloads within AnythingLLM services. [backend] info: [EncryptionManager] Loaded existing key & salt for encrypting arbitrary data. [backend] info: [production] AnythingLLM Standalone Backend listening on port 3001. Network discovery is disabled. [backend] info: prisma:info Starting a sqlite pool with 29 connections. [backend] info: [BackgroundWorkerService] Feature is not enabled and will not be started. [backend] info: [Event Logged] - workspace_created [backend] info: Purging source document of rag_test/doc_for_rag_test_new.txt-d3e2864c-66d0-4c01-ad54-6e2844395c66.json. [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [EncryptionManager] Loaded existing key & salt for encrypting arbitrary data. [collector] info: -- Working doc_for_rag_test_new.txt -- [collector] info: [SUCCESS]: doc_for_rag_test_new.txt converted & ready for embedding.

[backend] info: [CollectorApi] Document doc_for_rag_test_new.txt uploaded processed and successfully. It is now available in documents. [backend] info: [Event Logged] - document_uploaded [backend] info: Adding new vectorized document into namespace test5 [backend] info: [RecursiveSplitter] Will split with {"chunkSize":8192,"chunkOverlap":25} [backend] info: Chunks created from document: 2 [backend] info: [To] Embedding 2 chunks of text with mxbai-embed-large:latest. [backend] info: Inserting vectorized chunks into Chroma collection. [backend] error: addDocumentToNamespace Error embedding into ChromaDB [backend] error: Failed to vectorize doc_for_rag_test_new.txt [backend] info: [Event Logged] - workspace_documents_added [backend] info: Adding new vectorized document into namespace test5 [backend] info: [RecursiveSplitter] Will split with {"chunkSize":8192,"chunkOverlap":25} [backend] info: Chunks created from document: 2 [backend] info: [To] Embedding 2 chunks of text with mxbai-embed-large:latest. [backend] info: Inserting vectorized chunks into Chroma collection. [backend] error: addDocumentToNamespace Error embedding into ChromaDB [backend] error: Failed to vectorize doc_for_rag_test_new.txt [backend] info: [Event Logged] - workspace_documents_added [backend] info: [To] Embedding 1 chunks of text with mxbai-embed-large:latest. [backend] info: Cannonball results 7135 -> 469 tokens. [backend] info: [Event Logged] - sent_chat [backend] info: [Event Logged] - sent_chat [backend] info: [AgentHandler] Start faac0799-b953-4433-ab0a-809cc1321137::ollama:llama3.1:latest [backend] info: [AgentHandler] Attached websocket plugin to Agent cluster [backend] info: [AgentHandler] Attached chat-history plugin to Agent cluster [backend] info: [AgentHandler] Attaching user and default agent to Agent cluster. [backend] info: [AgentHandler] Attached rag-memory plugin to Agent cluster [backend] info: [AgentHandler] Attached document-summarizer plugin to Agent cluster [backend] info: [AgentHandler] Attached web-scraping plugin to Agent cluster [backend] info: [AgentHandler] Attached save-file-to-browser plugin to Agent cluster [backend] info: [AgentHandler] Attached create-chart plugin to Agent cluster [backend] info: [AgentHandler] Attached web-browsing plugin to Agent cluster [backend] info: [Event Logged] - sent_chat [backend] info: [AgentHandler] Start a162401d-f587-4b12-88a9-f0bac7dfdbf5::ollama:llama3.1:latest [backend] info: [AgentHandler] Attached websocket plugin to Agent cluster [backend] info: [AgentHandler] Attached chat-history plugin to Agent cluster [backend] info: [AgentHandler] Attaching user and default agent to Agent cluster. [backend] info: [AgentHandler] Attached rag-memory plugin to Agent cluster [backend] info: [AgentHandler] Attached document-summarizer plugin to Agent cluster [backend] info: [AgentHandler] Attached web-scraping plugin to Agent cluster [backend] info: [AgentHandler] Attached save-file-to-browser plugin to Agent cluster [backend] info: [AgentHandler] Attached create-chart plugin to Agent cluster [backend] info: [AgentHandler] Attached web-browsing plugin to Agent cluster [backend] info: [AgentLLM - llama3.1:latest] Valid tool call found - running document-summarizer. [backend] info: [AgentHandler] [debug]: @agent is attempting to call document-summarizer tool [backend] info: [AgentHandler] document-summarizer.summarizeDoc raised an error. Cannot read properties of undefined (reading 'length') [backend] info: [AgentLLM - llama3.1:latest] Valid tool call found - running document-summarizer. [backend] info: [AgentHandler] [debug]: @agent is attempting to call document-summarizer tool [backend] info: [AgentHandler] document-summarizer.summarizeDoc raised an error. Cannot read properties of undefined (reading 'length') [backend] info: [AgentLLM - llama3.1:latest] Function tool with exact arguments has already been called this stack. [backend] info: [AgentLLM - llama3.1:latest] Will assume chat completion without tool call inputs. [backend] info: [AgentLLM - llama3.1:latest] Function tool with exact arguments has already been called this stack. [backend] info: [AgentLLM - llama3.1:latest] Will assume chat completion without tool call inputs. [backend] info: Client took too long to respond, chat thread is dead after 300000ms [backend] info: [AgentHandler] End a162401d-f587-4b12-88a9-f0bac7dfdbf5::ollama:llama3.1:latest [backend] info: Client took too long to respond, chat thread is dead after 300000ms [backend] info: [AgentHandler] End faac0799-b953-4433-ab0a-809cc1321137::ollama:llama3.1:latest [backend] info: [Event Logged] - workspace_deleted [backend] info: [Event Logged] - workspace_created [backend] info: Purging source document of custom-documents/doc_for_rag_test_new.txt-89644e93-0b73-465f-ad75-f504ae64ad44.json. [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [EncryptionManager] Loaded existing key & salt for encrypting arbitrary data. [collector] info: -- Working doc_for_rag_test_new.txt -- [collector] info: [SUCCESS]: doc_for_rag_test_new.txt converted & ready for embedding. [backend] info: [CollectorApi] Document doc_for_rag_test_new.txt uploaded processed and successfully. It is now available in documents. [backend] info: [Event Logged] - document_uploaded [backend] info: Adding new vectorized document into namespace test5 [backend] info: [RecursiveSplitter] Will split with {"chunkSize":8192,"chunkOverlap":25} [backend] info: Chunks created from document: 2 [backend] info: [To] Embedding 2 chunks of text with mxbai-embed-large:latest. [backend] info: Inserting vectorized chunks into Chroma collection. [backend] error: addDocumentToNamespace Error embedding into ChromaDB [backend] error: Failed to vectorize doc_for_rag_test_new.txt [backend] info: [Event Logged] - workspace_documents_added [backend] info: Purging source document of custom-documents/doc_for_rag_test_new.txt-452c6071-6c0c-48ed-86ec-3c7ba6677dc0.json. [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [Event Logged] - workspace_documents_removed [backend] info: [EncryptionManager] Loaded existing key & salt for encrypting arbitrary data. [collector] info: -- Working doc_for_rag_test_new.txt -- [collector] info: [SUCCESS]: doc_for_rag_test_new.txt converted & ready for embedding.

[backend] info: [CollectorApi] Document doc_for_rag_test_new.txt uploaded processed and successfully. It is now available in documents. [backend] info: [Event Logged] - document_uploaded [backend] info: Adding new vectorized document into namespace test5 [backend] info: [RecursiveSplitter] Will split with {"chunkSize":8192,"chunkOverlap":25} [backend] info: Chunks created from document: 2 [backend] info: [To] Embedding 2 chunks of text with mxbai-embed-large:latest. [backend] info: Inserting vectorized chunks into Chroma collection. [backend] error: addDocumentToNamespace Error embedding into ChromaDB [backend] error: Failed to vectorize doc_for_rag_test_new.txt [backend] info: [Event Logged] - workspace_documents_added [backend] info: Adding new vectorized document into namespace test5 [backend] info: [RecursiveSplitter] Will split with {"chunkSize":8192,"chunkOverlap":25} [backend] info: Chunks created from document: 2 [backend] info: [To] Embedding 2 chunks of text with mxbai-embed-large:latest. [backend] info: Inserting vectorized chunks into Chroma collection. [backend] error: addDocumentToNamespace Error embedding into ChromaDB [backend] error: Failed to vectorize doc_for_rag_test_new.txt [backend] info: [Event Logged] - workspace_documents_added [backend] info: [To] Embedding 1 chunks of text with mxbai-embed-large:latest. [backend] info: Cannonball results 6520 -> 468 tokens. [backend] info: [Event Logged] - sent_chat

Hope this helps

Thank you

Hernan-V commented 1 week ago

Have the same issue. AnythingLLM locally in a MBP ChromaDB running on local server using docker.

Error show when trying to embed a document to the workspace, but still loading it to ChromaDB Everything works if I attach the file on a chat.