search

git-cloner / llama2-lora-fine-tuning

llama2 finetuning with deepspeed and lora
https://gitclone.com/aiit/chat/
MIT License
162 stars 14 forks source link

deepspeed这里是使用zero-1/2/3哪个模式切片的？ #15

Open rechawine opened 6 months ago

rechawine commented 6 months ago

我看这里好像并没用单独设置deepspeech.json，所以不大清楚