lobehub / lobe-chat

🤯 Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / Azure / DeepSeek), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Vision/TTS) and plugin system. One-click FREE deployment of your private ChatGPT/ Claude application.
https://chat-preview.lobehub.com
Other
44.46k stars 9.98k forks source link

[Request] 模型的stream功能开关 #802

Open suwubee opened 10 months ago

suwubee commented 10 months ago

🥰 需求描述 | Feature Description

对于自己二开的模型,有些是不支持stream的,但是lobe-chat默认全部走stream=true

🧐 解决方案 | Proposed Solution

允许非stream数据的接收

📝 补充信息 | Additional Information

No response

lobehubbot commented 10 months ago

👀 @suwubee

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible. Please make sure you have given us as much context as possible.\ 非常感谢您提交 issue。我们会尽快调查此事,并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

lobehubbot commented 10 months ago

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


🥰 Requirement Description | Feature Description

For the models developed by myself, some do not support stream, but lobe-chat defaults to stream=true

🧐 Solution | Proposed Solution

Allows reception of non-stream data

📝 Additional Information |

No response

LiXin-x commented 7 months ago

确实有必要,增加这个选项,部分模型/服务商存在不支持流式输出,会报错

lobehubbot commented 7 months ago

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


It is indeed necessary to add this option. Some models/service providers do not support streaming output and will report an error.

arvinxx commented 7 months ago

这个要做可能也只能给openai类的模型做。其他模型的调用方式可能都不一样

lobehubbot commented 7 months ago

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


This may only be done for openai models. Other models may be called differently