add multi nodes multi gpus config

jiahe7ay / MINI_LLM

This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.

327 stars 52 forks source link

Closed lumiere-ml closed 5 months ago

lumiere-ml commented 5 months ago

初步添加了多机多卡的配置以及训练方式