THUDM / ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型
Other
15.73k stars 1.85k forks source link

[BUG/Help] <title> ptuning的时候可以自定义loss吗? #656

Open hhy150 opened 10 months ago

hhy150 commented 10 months ago

Is there an existing issue for this?

Current Behavior

利用ptuning微调的时候,想自定义loss来实现特定的训练,不知道是否可以实现呢?

Expected Behavior

No response

Steps To Reproduce

暂无

Environment

- OS: Ubuntu 20.04
- Python: 3.9
- Transformers:4.30.2
- PyTorch: 2.0.1
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :True

Anything else?

No response