[New Model]: 请问接下来有支持诸如GPT-SoVITS之类的语音生成大模型的计划吗？

vllm-project / vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

https://docs.vllm.ai

Apache License 2.0

30.09k stars 4.55k forks source link

[New Model]: 请问接下来有支持诸如GPT-SoVITS之类的语音生成大模型的计划吗？ #9873

Open wyp19960713 opened 1 week ago

wyp19960713 commented 1 week ago

The model to consider.

https://huggingface.co/lj1995/GPT-SoVITS

The closest model vllm already supports.

No response

What's your difficulty of supporting the model you want?

No response

Before submitting a new issue...

[x] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

DarkLight1337 commented 1 week ago

We are still in the process of optimizing vLLM for X-to-text generation. I'd say that text-to-X generation is still quite some time away from being implemented in vLLM.