Mintplex-Labs / vector-admin

The universal tool suite for vector database management. Manage Pinecone, Chroma, Qdrant, Weaviate and more vector databases with ease.
https://vectoradmin.com/
MIT License
1.02k stars 173 forks source link

Embedders, one issue to rule them all #88

Open franzbischoff opened 6 months ago

franzbischoff commented 6 months ago

Requests to 3rd party integrations: #2 #69 Lack of guidance for new users: #61

After starting the quest for not using OpenAI embedded, that use a "magic number" of 1536 for their resulting vectors, we see that most on-premises (or competitors) use any other vector length for their reasons.

image

This creates one of the most known headaches for developers. So, this issue is here to:

  1. Remind the users that the embedding process differs from the "chat" process, and there is no standard yet. And to get worse, most Vector DBs still need to be ready for these non-standards.
  2. Remind the developers that this information shall be shown everywhere. Metadata, popups, labels, whatever.

my 2 cents