milvus-io / milvus-lite

A lightweight version of Milvus
Apache License 2.0
280 stars 33 forks source link

Does 2.4.10 really support different index type besides brute-force? #220

Open simshi opened 3 weeks ago

simshi commented 3 weeks ago

I looked into the code, segcore_wrapper always create Growing segment, and growing segment only use brute-force in search? If it's true, do you have plan to support different index type.

junjiejiangjjj commented 3 weeks ago

Yes, since sealed segment relies on complex logic such as binlog and compaction, milvus-lite does not integrate, brute-force performs well when the data size is hundreds of thousands, so the support priority for the index is not high.

simshi commented 3 weeks ago

still hope to support various types of indexing, as the index type is an important concept in vector databases (if not a key concept). Perhaps the implementation could be simplified? :flushed:

xiaofan-luan commented 3 weeks ago

We will start work on this once 2.5 is released. Please hold this for a while