search

xorbitsai / inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
https://inference.readthedocs.io
Apache License 2.0
4.55k stars 356 forks source link

新版本的xinference，glm4不支持 tools 能力？ #1630

Closed HenryLiang closed 3 weeks ago

HenryLiang commented 2 months ago

使用 tools 调用"glm4-chat-1m"模型。报错如下错误。 openai.BadRequestError: Error code: 400 - {'detail': "Only ['chatglm3', 'gorilla-openfunctions-v1', 'qwen-chat', 'qwen1.5-chat'] support tool calls"}

qianchen94 commented 2 months ago

更新支持glm4-chat，但glm4-chat-1m也还是不行 BadRequestError: Error code: 400 - {'detail': "Only ['chatglm3', 'glm4-chat', 'gorilla-openfunctions-v1', 'qwen-chat', 'qwen1.5-chat', 'qwen2-instruct'] support tool calls"}

github-actions[bot] commented 3 weeks ago

This issue is stale because it has been open for 7 days with no activity.