search

OpenMOSS / MOSS

An open-source tool-augmented conversational language model from Fudan University
https://txsun1997.github.io/blogs/moss.html
Apache License 2.0
11.95k stars 1.15k forks source link

AttributeError: 'NoneType' object has no attribute 'deepspeed_config' #80

Open HDRBgg opened 1 year ago

HDRBgg commented 1 year ago

Traceback (most recent call last): File "finetune_moss.py", line 303, in train(args) File "finetune_moss.py", line 175, in train accelerator.state.deepspeed_plugin.deepspeed_config['train_micro_batch_size_per_gpu'] = args.train_bsz_per_gpu AttributeError: 'NoneType' object has no attribute 'deepspeed_config'

flomok commented 1 year ago

Hi,I have the same mistake,have you solve it？

HDRBgg commented 1 year ago

分布式训练的问题，还没解决

lby129 commented 1 year ago

你好，请问解决了吗？我也遇到同样的问题。

flomok commented 1 year ago

不好意思，我也没有解决呢

------------------ 原始邮件 ------------------ 发件人: "OpenLMLab/MOSS" @.>; 发送时间: 2023年5月5日(星期五) 下午2:50 @.>; @.**@.>; 主题: Re: [OpenLMLab/MOSS] AttributeError: 'NoneType' object has no attribute 'deepspeed_config' (Issue #80)

你好，请问解决了吗？我也遇到同样的问题。

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.***>

hjing100 commented 1 year ago

同样的问题，请问解决了吗 运行报错： python finetune_moss.py --model_name_or_path /web/pretrained_model/moss-moon-003-sft --data_dir ./SFT_data --output_dir ./ckpts/moss-moon-003-sft --log_dir ./train_logs/moss-moon-003-sft --n_epochs 2 --train_bsz_per_gpu 4 --eval_bsz_per_gpu 4 --learning_rate 0.000015 --eval_step 200 --save_step 2000

KickyGong commented 1 year ago

我也遇到了同样的问题，除了存储路径之外没动别的参数。会不会是某些包的版本的问题？

Taurus9527 commented 1 year ago

我也遇到同样的问题，各位解决了吗？