[Bug] Fix DoReMi's DRO Loss - Githubissues

huggingface / nanotron

Minimalistic large language model 3D-parallelism training

Apache License 2.0

1.23k stars 122 forks source link

[Bug] Fix DoReMi's DRO Loss #119

Closed xrsrke closed 7 months ago