search

epfLLM / Megatron-LLM

distributed trainer for LLMs
Other
529 stars 76 forks source link

Multi nodes #98

Closed wodeqiansuihan closed 6 months ago

wodeqiansuihan commented 7 months ago

I have 16x4090 on two machines, each with 8 sheets on top. How can I use this project ?

martinjaggi commented 6 months ago

you can follow the getting started guide. it supports multi-node by default