milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
30.27k stars 2.91k forks source link

[Bug]: compaction task meta leak during cluster restart #36020

Open wayblink opened 1 month ago

wayblink commented 1 month ago

Is there an existing issue for this?

Environment

- Milvus version:
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

image

The task stay pipelining during cluster restart and was dropped in memory because the vchannel is dropped. The compaction task meta is not cleaned properly, and will stay in meta forever.

Expected Behavior

No response

Steps To Reproduce

No response

Milvus Log

No response

Anything else?

No response

wayblink commented 1 month ago

/assign

wayblink commented 1 month ago

/unassign @yanliang567