[Enhancement]: use async cgo in insert and delete opeartion

milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications

https://milvus.io

Apache License 2.0

31.06k stars 2.95k forks source link

[Enhancement]: use async cgo in insert and delete opeartion #37638

Open chyezh opened 2 weeks ago

chyezh commented 2 weeks ago

Is there an existing issue for this?

[X] I have searched the existing issues

What would you like to be added?

Found that insert and delete may be a long time cgo opeartion, so use async cgo for insert and delete opeartions.

Also see issue: #37413

Why is this needed?

No response

Anything else?

No response

chyezh commented 2 weeks ago

/assign

xiaofan-luan commented 2 weeks ago

Is there an existing issue for this?

[x] I have searched the existing issues

What would you like to be added?

Found that insert and delete may be a long time cgo opeartion, so use async cgo for insert and delete opeartions.

Also see issue: #37413

Why is this needed?

No response

Anything else?

No response

Is there a big difference?

chyezh commented 2 weeks ago

Is there a big difference?

Same like search and query, avoid long-time-cgo-call to hold on the go's threads.

xiaofan-luan commented 2 weeks ago

I think we need to fix the cpp issue first becasue insert/delete is not designed to be long calls