search

zjunlp / IEPile

[ACL 2024] IEPile: A Large-Scale Information Extraction Corpus
http://oneke.openkg.cn/
Other
166 stars 15 forks source link

AttributeError: 'HfDeepSpeedConfig' object has no attribute 'trainer_config_finalize #12

Closed EternalSeer closed 6 months ago

EternalSeer commented 6 months ago

ce90d0e5-f59e-42ae-a397-6cf1541599ef baichuan和lama都报这个错，大佬求助

guihonghao commented 6 months ago

你是否使用的是qlora，即--bits 4

guihonghao commented 6 months ago

https://github.com/microsoft/DeepSpeed/issues/3733#issuecomment-1671891244 将--deepspeed configs/ds_config_bf16.json去掉，或者试试将deepspeed升级到0.10.0

zxlzr commented 6 months ago

请问您的问题是否已解决？

EternalSeer commented 6 months ago

microsoft/DeepSpeed#3733 (comment) 将--deepspeed configs/ds_config_bf16.json去掉，或者试试将deepspeed升级到0.10.0

使用的第一种方式，通了，多谢大佬

EternalSeer commented 6 months ago

请问您的问题是否已解决？

上面大佬给的方式，已解决