milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
29.37k stars 2.82k forks source link

[Bug]: GetQueryInfo return dropped segment dropped by L2 single compaction #35003

Open wayblink opened 1 month ago

wayblink commented 1 month ago

Is there an existing issue for this?

Environment

- Milvus version: master/2.4
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

GetQueryInfo return dropped segment dropped by L2 single compaction because we regard a dropped segment as valid if it is L2 and its partitionStatsVersion == currentPartitionStatsVersion. This is to handle the indexing stage of clustering compaction https://github.com/milvus-io/milvus/blob/63f0154dfb420b68c18b8a41dd8830633327495c/internal/datacoord/handler.go#L157-#L166

Expected Behavior

No response

Steps To Reproduce

No response

Milvus Log

No response

Anything else?

No response

wayblink commented 1 month ago

/assign

wayblink commented 1 month ago

/unassgin @yanliang567