milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
29.44k stars 2.82k forks source link

[Feature]: Add new kind support for meta store #33828

Closed ArenaSu closed 3 months ago

ArenaSu commented 3 months ago

Is there an existing issue for this?

Is your feature request related to a problem? Please describe.

The following types of meta store are currently supported by the community:

I want to contribute new kinds.Please help to check which one of the following types is appropriate:

Describe the solution you'd like.

I prefer to choose RoseDB as it is written by golang. Other option is also ok for me.

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

xiaofan-luan commented 3 months ago

For standalone : use embedded etcd For smaller cluster : use etcd with 3 nodes For large cluster : use etcd as service discovery + tikv as distributed meta.

I think add rocksdb support for standalone might be an option. adding sql database is not a option because maintain schema is hard.

ArenaSu commented 3 months ago

For standalone : use embedded etcd For smaller cluster : use etcd with 3 nodes For large cluster : use etcd as service discovery + tikv as distributed meta.

I think add rocksdb support for standalone might be an option. adding sql database is not a option because maintain schema is hard.

@xiaofan-luan rocksdb is already supported. Could any other kv database be a choose ? Or can add a new MQ(message queue) kind ?

xiaofan-luan commented 3 months ago

rocksdb is not supported as meta store yet

ArenaSu commented 3 months ago

rocksdb is not supported as meta store yet

@xiaofan-luan I found internal/kv/rocksdb/rocksdb_kv.go file in milvus master branch. Does this prove that it is supported?