search

intelligent-machine-learning / dlrover

DLRover: An Automatic Distributed Deep Learning System
Other
1.23k stars 154 forks source link

An example to support nanoGPT. #439

Closed workingloong closed 1 year ago

workingloong commented 1 year ago

nanoGPT is the simplest, fastest repository for training/finetuning medium-sized GPTs. We can use nanoGPT to test fault-tolerance and elasticity of DLRover.

merlintang commented 1 year ago

+1

yzlnew commented 1 year ago

Maybe consider nanoGPT?

workingloong commented 1 year ago

Maybe consider nanoGPT?

Yeah. minGPT is rewritten by nanoGPT.

Antlera commented 1 year ago

Add the example to support nanoGPT by #516 .