TTS curl Internal Server Error

[tsiens]

System Info / 系統信息

cuda12.1

Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？

• [X] docker / docker
• [ ] pip install / 通过 pip install 安装
• [ ] installation from source / 从源码安装

Version info / 版本信息

0.13.3

The command used to start Xinference / 用以启动 xinference 的命令

docker

Reproduction / 复现过程

Xinference python success but curl error

curl -X 'POST' \
>   'http://127.0.0.1:9997/v1/audio/speech' \
>   -H 'accept: application/json' \
>   -H 'Content-Type: application/json' \
>   -d '{
>     "model": "ChatTTS",
>     "text": "你好",
>     "voice": "中文女"
>   }'
Internal Server Error

curl -X 'POST' \
>   'http://127.0.0.1:9997/v1/audio/speech' \
>   -H 'accept: application/json' \
>   -H 'Content-Type: application/json' \
>   -d '{
>     "model": "CosyVoice-300M-SFT",
>     "text": "你好",
>     "voice": "中文女"
>   }'
Internal Server Error

Expected behavior / 期待表现

return result as

curl -X 'POST' \
>   'http://127.0.0.1:9997/v1/chat/completions' \
>   -H 'accept: application/json' \
>   -H 'Content-Type: application/json' \
>   -d '{
>     "model": "qwen2-instruct",
>     "messages": [
>         {
>             "role": "system",
>             "content": "You are a helpful assistant."
>         },
>         {
>             "role": "user",
>             "content": "What is the largest animal?"
>         }
>     ],
>     "max_tokens": 512,
>     "temperature": 0.7
>   }'
{"id":"chatfad8c3cd-6e0b-49a8-b4c8-f082362712f9","object":"chat.completion","created":1722499076,"model":"qwen2-instruct","choices":[{"index":0,"message":{"role":"assistant","content":"The largest animal is the blue whale (Balaenoptera musculus). Adult blue whales can grow up to 100 feet (30 meters) in length and weigh as much as 200 tons (about 400,000 pounds or 181,437 kilograms). They live in all of the world's oceans, but their populations were severely depleted by commercial whaling activities that historically targeted them. Despite being listed as an endangered species globally since the early 1970s, some populations have shown signs of recovery due to conservation efforts and restrictions on whaling. Blue whales feed primarily on krill, which they catch by opening their mouths wide and engulfing large volumes of water rich with prey particles before filtering it out through comb-like baleen plates hanging from their upper jaws."},"finish_reason":"stop"}],"usage":{"prompt_tokens":25,"completion_tokens":172,"total_tokens":197}}

[qinxuye]

Do you have the error stack on the server side?

[tsiens]

Do you have the error stack on the server side?

No output at all

[qinxuye]

@codingl2k1 Please take look at this issue.

[codingl2k1]

@codingl2k1 Please take look at this issue.

OK

[codingl2k1]

Please try this curl:

curl -X 'POST' \
   'http://127.0.0.1:9997/v1/audio/speech' \
   -H 'accept: application/json' \
   -H 'Content-Type: application/json' \
   -d '{
     "model": "CosyVoice-300M-SFT",
     "input": "你好",
     "voice": "中文女"
   }'

If you want to make a request with binary voice, it should be in the form of a request. Please refer to the Xinference client: https://github.com/xorbitsai/inference/blob/main/xinference/client/restful/restful_client.py#L764

[leslie2046]

stream参数去除即可