milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
31.05k stars 2.95k forks source link

[Bug]: indexnode panic when upgrade from 2.2.3 to 2.2.8 #24259

Closed bingbb47 closed 1 year ago

bingbb47 commented 1 year ago

Is there an existing issue for this?

Environment

- Milvus version:2.2.8
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

look likes something wrong about aws s3 but upgrade without s3 config change, and the panic only occured on indexnode

Expected Behavior

No response

Steps To Reproduce

No response

Milvus Log

indexnode.log

Anything else?

No response

yanliang567 commented 1 year ago

/assign @longjiquan /unassign

yanliang567 commented 1 year ago

but reproduced in house without aws s3

xiaocai2333 commented 1 year ago

but reproduced in house without aws s3

@bingbb47 indexnode is stateless, please check your own environment configuration.

@yanliang567 if you reproduced it, please upload the log.

xiaocai2333 commented 1 year ago

Guess the cause of the panic is the same as #25129 , the wrong use of the noexcept keyword.

xiaocai2333 commented 1 year ago

has been fixed. /unassign /assign @yanliang567

yanliang567 commented 1 year ago

@bingbb47 could you please retry on milvus v.2.2.12? /assign @bingbb47 /unassign

bingbb47 commented 1 year ago

@bingbb47 could you please retry on milvus v.2.2.12? /assign @bingbb47 /unassign

This problem seems to have some random factors, and has not been discovered since v2.2.8 version

stale[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.