hiyouga / LLaMA-Factory

Unify Efficient Fine-Tuning of 100+ LLMs
Apache License 2.0
25.52k stars 3.16k forks source link

怎样使用accelerate库进行微调呢? #4601

Closed shenxiaochenn closed 5 days ago

shenxiaochenn commented 5 days ago

Reminder

System Info

已按照要求安装

Reproduction

我在example里面只看到了deepspeed,而默认是 ddp.如何使用accelerate进行分布式微调呢?

Expected behavior

希望有一个使用accelerate的demo!

Others

No response

hiyouga commented 5 days ago

accelerate launch src/train.py 后面加参数就行