search

THUDM / ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型
Other
15.68k stars 1.85k forks source link

[BUG/Help] <title>请问是否支持设置beam size >1，并将生成的多个输出一起返回呢？ #609

Open kuranatsu opened 10 months ago

kuranatsu commented 10 months ago

Is there an existing issue for this?

Current Behavior

请问是否能够在推理的时候使用beam search，同时将生成的多个输出一起返回呢？谢谢！

Expected Behavior

No response

Steps To Reproduce

无

Environment

无

Anything else?

No response