[Feature]: Milvus adapt GPU like Huawei 910B

milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications

https://milvus.io

Apache License 2.0

28.08k stars 2.71k forks source link

[Feature]: Milvus adapt GPU like Huawei 910B #33885

Open bjgyl opened 2 weeks ago

bjgyl commented 2 weeks ago

Is there an existing issue for this?

[X] I have searched the existing issues

Is your feature request related to a problem? Please describe.

随着越来越多的国内厂商采购国产GPU，如百度、科大讯飞等采购了华为910B，国产化适配越来越重要，希望milvus能早日适配国产GPU。

Describe the solution you'd like.

No response

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

github-actions[bot] commented 2 weeks ago

The title and description of this issue contains Chinese. Please use English to describe your issue.

xiaofan-luan commented 2 weeks ago

we are open to contribution. Any volunteers? we can discuss on it.

jiangyinzuo commented 2 weeks ago

knowhere depends on rapidsai/raft, which is developed by Nvidia and only supports CUDA. However, Huawei's GPU does not support CUDA, it has its own development kit CANN. So we need to rewrite all the GPU ANNS algorithms in CANN if we want to adapt Huawei's GPUs.

xiaofan-luan commented 1 week ago

we will need huawei team to support an ann algorithm on their device.

This is not our prioprity for now, but we are looking forward to any contribution from community