milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
31.08k stars 2.95k forks source link

[Bug]: Large segment list cause DataNode watch channel failed. #36025

Open aoiasd opened 2 months ago

aoiasd commented 2 months ago

Is there an existing issue for this?

Environment

- Milvus version:Master and 2.4.10
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

When watch channel with large num of segment, because GetSegmentInfo will timeout. Even through we split large segment list to small requests, but now we have to get all result within 5s.

Expected Behavior

Each request needs its own timeout.

Steps To Reproduce

No response

Milvus Log

No response

Anything else?

No response

yanliang567 commented 2 months ago

/assign @aoiasd /unassign

stale[bot] commented 3 weeks ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

xiaofan-luan commented 3 weeks ago

is this still a bug?