Closed wang0yue closed 1 month ago
Bot detected the issue body's language is not English, translate it automatically.
Title: [Feature Request] Request to adapt o1 non-stream output
目前已经解决并做好了docker容器,修改的地方挺多,主要是将chat.ts中的: stream: true 替换为 stream: modelConfig.model.startsWith("o1") ? false : true 目前平稳运行,另外请求时要将temperature设置为1
Bot detected the issue body's language is not English, translate it automatically.
At present, the docker container has been solved and completed. There are many modifications, mainly the following in chat.ts: stream: true Replace with stream: modelConfig.model.startsWith("o1") ? false : true It is currently running smoothly. In addition, the temperature must be set to 1 when requesting.
这个模型很多参数不支持,我查下资料统一处理下吧。
Bot detected the issue body's language is not English, translate it automatically.
Many parameters of this model are not supported. I will check the information and deal with them uniformly.
同步了上游的兼容适配,可以试试看现在是否正常了。
Bot detected the issue body's language is not English, translate it automatically.
The upstream compatible adaptation has been synchronized. You can try it to see if it is normal now.
🥰 需求描述
{ "error": { "message": "Unsupported value: 'stream' does not support true with this model. Only the default (false) value is supported. (request id: 2024xxx)", "type": "invalid_request_error", "param": "stream", "code": "unsupported_value" } }
🧐 解决方案
更改o1默认stream参数,或者能自行选择
📝 补充信息
No response