huggingface / nanotron

Minimalistic large language model 3D-parallelism training
Apache License 2.0
1.14k stars 107 forks source link

[Unit Test] Add unit test for DoReMi's trainer #89

Open xrsrke opened 7 months ago