THUDM / ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型
Other
15.71k stars 1.85k forks source link

[Help] 请问chatGLM是否能实现类似openai log_probs的功能? #559

Open HarryZhou-618 opened 1 year ago

HarryZhou-618 commented 1 year ago

Is there an existing issue for this?

Current Behavior

chatGLM2是否能实现类似openai log_probs的功能,针对选择题直接输出选项的概率?这对大模型使用和探索应该是很有帮助的。

Expected Behavior

No response

Steps To Reproduce

no steps

Environment

- OS:
- Python:
- Transformers:
- PyTorch:
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :

Anything else?

No response

xiabo0816 commented 1 year ago

+1