search

clue-ai / ChatYuan

ChatYuan: Large Language Model for Dialogue in Chinese and English
https://www.clueai.cn
Other
1.9k stars 183 forks source link

微调时无法使用FP16损失为nan #58

Open WangYuhang123 opened 1 year ago

WangYuhang123 commented 1 year ago

您好，我在尝试微调过程中开启FP16加速训练 ，但loss一直为nan，想问下您如何使用FP16微调chatyuan，感谢！