milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
30.19k stars 2.89k forks source link

[Bug]: `BloomFilterSet.BatchPkExist` may return false negative when `K` values differ among candidates #35379

Closed congqixia closed 1 month ago

congqixia commented 2 months ago

Is there an existing issue for this?

Environment

- Milvus version: master & 2.4.6
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

BloomFilterSet.BatchPkExist may return false negative when K values differ among candidates, which may cause delete failed to apply to corresponding segments

Expected Behavior

BloomFilterSet.BatchPkExist shall works fine when K differs among segment candidates

Steps To Reproduce

No response

Milvus Log

No response

Anything else?

No response

xiaofan-luan commented 2 months ago

nice catch!

stale[bot] commented 1 month ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.