THUDM / ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型
Other
15.71k stars 1.85k forks source link

[BUG/Help] 基于文档问答的stream输出和非stream输出不一致,stream输出会有格式混乱的情况 #589

Closed y111x closed 12 months ago

y111x commented 1 year ago

Is there an existing issue for this?

Current Behavior

stream输出会偶然漏掉输出文本中的序号,换行符之类的。例如: 1.今天天气很好。.昨天天气不错 3.明天天气一定会很好 丢掉了\n2

Expected Behavior

No response

Steps To Reproduce

搜索出文档后,使用流式输出

Environment

- OS:linux
- Python:3+
- Transformers:
- PyTorch:
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :

Anything else?

No response