How to implement multi-gpu training

project-baize / baize-chatbot

Let ChatGPT teach your own chatbot in hours with a single GPU!

https://arxiv.org/abs/2304.01196

GNU General Public License v3.0

3.15k stars 275 forks source link

Closed chlinfeng1997 closed 1 year ago

chlinfeng1997 commented 1 year ago

hello，there are 8 gpus on my machine, how to train in parallel?