xorbitsai / inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
https://inference.readthedocs.io
Apache License 2.0
4.87k stars 386 forks source link

能否接入Qwen-Audio-Chat模型? #1523

Closed WholeWorld-Timothy closed 4 months ago

WholeWorld-Timothy commented 4 months ago

Describe the solution you'd like

在语音模型中能否接入Qwen-Audio-Chat模型?我们发现whisper对中文的转录并不是太好,Qwen-Audio-Chat效果好得多,能否在语音模型中接入Qwen-Audio-Chat?

qinxuye commented 4 months ago

Duplicated with #1072 .

WholeWorld-Timothy commented 4 months ago

https://github.com/xorbitsai/inference/issues/1072 跟我这个说的是一个事么?1072问的是Qwen-Audio是否支持openai的api,我问的是xinference能否在audio models里面支持qwen-audio-chat,1072里面那回复说的是xinference是不是支持audio,这是打算咋处理,能明确说一下么?我表示很晕。