milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
29.42k stars 2.82k forks source link

[Bug]: milvus standalone crash by bitset assert check fail #34849

Closed cqy123456 closed 2 days ago

cqy123456 commented 1 month ago

Is there an existing issue for this?

Environment

- Milvus version: 2.4-ff4bd2c(debug version)

Current Behavior

image

Expected Behavior

No response

Steps To Reproduce

argo link: https://argo-workflows.zilliz.cc/workflows/qa/fouramf-nxg56?tab=workflow
After inserting 2 million pieces of data, continue to upsert, and statistics query  count(*) for 1h, each upsert 2000 pieces of data. There are more than 500 times count(*) statistics is less than the correct value.
pod info:
6-14-2808-zookeeper|fouramf-nxg56-14-2808-kafka|fouramf-nxg56-14-2808-log|fouramf-nxg56-14-2808-tikv'  (util_cmd.py:14)
fouramf-nxg56-3510939668: [2024-07-19 09:53:57,995 -  INFO - fouram]: [CliClient] pod details of release(fouramf-nxg56-14-2808):
fouramf-nxg56-3510939668: fouramf-nxg56-14-2808-etcd-0                                      1/1     Running     0                3m
46s   10.104.19.238   4am-node28   <none>           <none>
fouramf-nxg56-3510939668: fouramf-nxg56-14-2808-milvus-standalone-77756ddd8f-r4s9k          1/1     Running     3 (2m33s ago)    3m
46s   10.104.19.237   4am-node28   <none>           <none>
fouramf-nxg56-3510939668: fouramf-nxg56-14-2808-minio-77b84cf6f6-qx78k                      1/1     Running     0                3m
46s   10.104.19.236   4am-node28   <none>           <none> (cli_client.py:144)

Milvus Log

No response

Anything else?

No response

yanliang567 commented 1 month ago

/assign @czs007 /unassign

xiaofan-luan commented 1 month ago

@zhagnlu

please take an eye on this issue as well