search

HarderThenHarder / transformers_tasks

⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SFT etc.
https://www.zhihu.com/column/c_1451236880973426688
2.17k stars 381 forks source link

多卡训练，无法运行train_multi_gpu.sh #52

Open cheney369 opened 1 year ago

cheney369 commented 1 year ago

sh train_multi_gpu.py之后，控制台出现WARING后无其他信息，几秒后直接跳出。这个是什么原因呢？

root@pt_exp://data/chatglm/chatglm-6B/fine_tuning# sh train_multi_gpu.sh [09:32:06] WARNING The following values were not passed to accelerate launch and had defaults used instead: root@pt_exp://data/chatglm/chatglm-6B/fine_tuning#

pengcao commented 1 year ago

我重新更新了一下bitsandbytes 就可以了