search

datastrato / gravitino

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
https://datastrato.ai/docs/
Apache License 2.0
657 stars 200 forks source link

[EPIC] Support manage vector database as a new kind of catalog #3842

Open jerryshao opened 2 weeks ago

jerryshao commented 2 weeks ago

Describe the proposal

This issue tracks the work of managing new vector type data from vector database as a new kind of catalog. Currently, it is still in a very preliminary stage, so I'd create an issue to collect feedbacks from the community.

Task list

N/A

zhoukangcn commented 2 weeks ago

Great idea. We might have this requirement at Xiaomi in the next few months. As far as I am aware, we use Milvus as a vector database in RAG, and there could be scenarios that require a Milvus catalog, such as data integration, data querying.