search

OpenMOSS / MOSS

An open-source tool-augmented conversational language model from Fudan University
https://txsun1997.github.io/blogs/moss.html
Apache License 2.0
11.92k stars 1.14k forks source link

AttributeError: 'DeepSpeedZeRoOffload' object has no attribute 'backward' #273

Open lizhidomg opened 1 year ago

lizhidomg commented 1 year ago

File "finetune_moss.py", line 241, in train accelerator.backward(loss) 代码运行到这一行报错， AttributeError: 'DeepSpeedZeRoOffload' object has no attribute 'backward'

lizhidomg commented 1 year ago

这个是微调时候的报错

YoloZyk commented 7 months ago

兄弟解决了吗，我使用moss-moon-003-sft的jupyter测试样例时也有类似错误