search

TabbyML / tabby

Self-hosted AI coding assistant
https://tabby.tabbyml.com/
Other
21.52k stars 976 forks source link

Err(StreamError("Invalid header value: \"application/json\"")) #2184

Closed chenglu66 closed 5 months ago

chenglu66 commented 5 months ago

Describe the bug A clear and concise description of what the bug is.

Information about your version Please provide output of tabby --version

Information about your GPU Please provide output of nvidia-smi

Additional context Add any other context about the problem here.

wsxiaoys commented 5 months ago

Hi, please provide detailed steps to reproduce the issue, eg command you used to start tabby.

chenglu66 commented 5 months ago

Hi, please provide detailed steps to reproduce the issue, eg command you used to start tabby. OK cargo run serve --device experimental-http \ --model '{"kind": "openai", "model_name": "codellama/CodeLlama-70b-Instruct-hf", "api_endpoint": "xxxxxx:8080/v1", "prompt_template": ""}'