search

THUDM / ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型
Other
15.7k stars 1.85k forks source link

[Help] chatGLM2-6B是否支持直接注入整篇文档进行微调，如果支持怎么处理 #655

Open wangfenglei-hehe opened 8 months ago

wangfenglei-hehe commented 8 months ago

Is there an existing issue for this?

Current Behavior

chatGLM2-6B是否支持直接注入整篇文档进行微调，如果支持的话怎么做？目前从官方文档只看到key-value形式。

Expected Behavior

No response

Steps To Reproduce

需要知道进行整篇文档注入微调方法

Environment

- OS:Ubuntu 20.04
- Python: 3.8
- Transformers:4.26.1
- PyTorch:1.12
- CUDA Support：True

Anything else?

No response

haitongwan commented 8 months ago

蹲个大佬