xorbitsai / inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
https://inference.readthedocs.io
Apache License 2.0
5.28k stars 426 forks source link

SenseVoiceSmall 离线环境启动报错 #2273

Closed luhairong11 closed 1 month ago

luhairong11 commented 1 month ago

System Info / 系統信息

官方镜像v0.15.0版本

Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?

Version info / 版本信息

官方镜像v0.15.0版本

The command used to start Xinference / 用以启动 xinference 的命令

xinference launch --model-name SenseVoiceSmall --model-type audio --gpu-idx 7 --model_path /data/models/audio/iic/SenseVoiceSmall

Reproduction / 复现过程

image image

Expected behavior / 期待表现

离线环境也可以使用SenseVoiceSmall

qinxuye commented 1 month ago

这是个已知问题,需要看下 SenseVoiceSmall 联网做了什么操作。

luhairong11 commented 1 month ago

有一个vad的模型需要下载

github-actions[bot] commented 1 month ago

This issue is stale because it has been open for 7 days with no activity.

github-actions[bot] commented 1 month ago

This issue was closed because it has been inactive for 5 days since being marked as stale.

Copilotes commented 2 weeks ago

有一个vad的模型需要下载

哪个模型?有什么具体的操作能解决这个问题吗?