search

xorbitsai / inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
https://inference.readthedocs.io
Apache License 2.0
4.86k stars 385 forks source link

支持昇腾处理器 #1689

Closed zhubao315 closed 1 month ago

zhubao315 commented 3 months ago

同标题

qinxuye commented 3 months ago

目前支持的。我们补充一个文档说明。

ShawJiang commented 2 months ago

期待文档说明，感谢！

HOLYYUN commented 2 months ago

说明文档已经上传了么？

messiahxu commented 2 months ago

期待文档说明，感谢！

blvyoucan commented 2 months ago

期待文档说明，感谢！

SunreeenlonG1992 commented 2 months ago

+1

Halfknow commented 2 months ago

+1，支持昇腾910b