THUDM / ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型
Other
15.65k stars 1.85k forks source link

[BUG/Help] <title> ptuning的时候可以自定义loss吗? #656

Open hhy150 opened 6 months ago

hhy150 commented 6 months ago

Is there an existing issue for this?

Current Behavior

利用ptuning微调的时候,想自定义loss来实现特定的训练,不知道是否可以实现呢?

Expected Behavior

No response

Steps To Reproduce

暂无

Environment

- OS: Ubuntu 20.04
- Python: 3.9
- Transformers:4.30.2
- PyTorch: 2.0.1
- CUDA Support (`python -c "import torch; print(torch.cuda.is_available())"`) :True

Anything else?

No response