Open fangyiwb opened 1 month ago
Linux
=3.11
main
[X] Installation From Source
[ ] Docker Installation
[ ] Docker Compose Installation
[ ] Cluster Installation
[ ] AutoDL Image
[ ] Other
gpu=4090
llm=qwen2-7b
如何暂停大模型输出?只能等大模型全部输出结束吗?有没有相应接口呢?
output tokens
发送prompt
No response
Not yet implemented
期待中
This issue has been marked as stale, because it has been over 30 days without any activity.
stale
Search before asking
Operating system information
Linux
Python version information
DB-GPT version
main
Related scenes
Installation Information
[X] Installation From Source
[ ] Docker Installation
[ ] Docker Compose Installation
[ ] Cluster Installation
[ ] AutoDL Image
[ ] Other
Device information
gpu=4090
Models information
llm=qwen2-7b
What happened
如何暂停大模型输出?只能等大模型全部输出结束吗?有没有相应接口呢?
What you expected to happen
output tokens
How to reproduce
发送prompt
Additional context
No response
Are you willing to submit PR?