Mintplex-Labs / vector-admin

The universal tool suite for vector database management. Manage Pinecone, Chroma, Qdrant, Weaviate and more vector databases with ease.
https://vectoradmin.com/
MIT License
1.49k stars 227 forks source link

Vectors without a namespace #27

Closed ayso-ai closed 1 year ago

ayso-ai commented 1 year ago

VectorAdmin not pulling data from Pinecone for vectors without a namespace. Is that a known issue or am I missing something?

timothycarambat commented 1 year ago

It currently does not support non-namespaced vectors. This is something that can be supported, but likely will cause complications as the name in pinecone for "no namespace" is just "" which will cause issues on the DB side of handling this.

Are you just querying on a specific metadata across all your vectors instead of namespacing? Or is this specific to your use case?

ayso-ai commented 1 year ago

I'm using Flowise to upsert documents to Pinecone and it looks like it does so without using namespaces. Not sure about a workaround here...

On Mon, Aug 7, 2023 at 1:24 PM Timothy Carambat @.***> wrote:

It currently does not support non-namespaced vectors. This is something that can be supported, but likely will cause complications as the name in pinecone for "no namespace" is just "" which will cause issues on the DB side of handling this.

Are you just querying on a specific metadata across all your vectors instead of namespacing? Or is this specific to your use case?

— Reply to this email directly, view it on GitHub https://github.com/Mintplex-Labs/vector-admin/issues/27#issuecomment-1668522303, or unsubscribe https://github.com/notifications/unsubscribe-auth/BBOKJYZEEIHWWPE4K3DDBALXUFFILANCNFSM6AAAAAA3GNAQIQ . You are receiving this because you authored the thread.Message ID: @.***>

timothycarambat commented 1 year ago

It's good practice to partition the data into namespaces. Flowise does support this! You just need to define it so it is used during execution.

Screen Shot 2023-08-08 at 1 03 36 PM Screen Shot 2023-08-08 at 1 03 41 PM