milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
31.01k stars 2.95k forks source link

[Feature]: For supportting AI accelerator cards in Milvus #21550

Open TeslaZhao opened 1 year ago

TeslaZhao commented 1 year ago

Is there an existing issue for this?

Is your feature request related to a problem? Please describe.

Does it support other AI accelerator cards for computing? Is there a related plan or document?for example,kunlunxpu, Hygon DCU and so on.

Describe the solution you'd like.

No response

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

xiaofan-luan commented 1 year ago

we have plan to support general GPU device. but not other device. If anyone interested in contributing it works

TeslaZhao commented 1 year ago

Thank you for your reply! Do you have any design documents about adapting devices?

xiaofan-luan commented 1 year ago

@liliu-z @Presburger

TeslaZhao commented 1 year ago

Sorry, is there any response?

liliu-z commented 1 year ago

/assign @Presburger @liliu-z That is on our roadmap to do a flexible integration of 3rdparty device. If this feature is really high priority to you, we can discuss offline to find see more Possibilities. Feel free to email me @ li.liu@zilliz.com

Presburger commented 1 year ago

@TeslaZhao In the first half of this year, we will consider investigating the possibility of habana AI chip in milvus as a exhaustive search acceleration, which will take time. Thanks

TeslaZhao commented 1 year ago

Thank you all, I have another question, does milvus support compilation and use on the ARM platform?

TeslaZhao commented 1 year ago

/assign @Presburger @liliu-z That is on our roadmap to do a flexible integration of 3rdparty device. If this feature is really high priority to you, we can discuss offline to find see more Possibilities. Feel free to email me @ li.liu@zilliz.com

It can be seen that it is difficult to make this feature. I want to know the time cost of doing this job?

liliu-z commented 1 year ago

/assign @Presburger @liliu-z That is on our roadmap to do a flexible integration of 3rdparty device. If this feature is really high priority to you, we can discuss offline to find see more Possibilities. Feel free to email me @ li.liu@zilliz.com

It can be seen that it is difficult to make this feature. I want to know the time cost of doing this job?

It depends on the priority and this item. Can I ask what use case do you have?

Presburger commented 1 year ago

Thank you all, I have another question, does milvus support compilation and use on the ARM platform?

@TeslaZhao YES,Milvus now can use on the ARM64 platform.

sbates130272 commented 1 year ago

Compiling Milvus on Arm-based systems is currently broken. Cross compiling to arm from an amd64 based system might work.

liliu-z commented 1 year ago

Compiling Milvus on Arm-based systems is currently broken. Cross compiling to arm from an amd64 based system might work.

Can I ask the what version Milvus are you using?

xiaohezi205 commented 1 year ago

加我1079361253微信 2.2.12版本arm64镜像免费送