Add check for model gradient in DDP - Githubissues

huggingface / nanotron

Minimalistic large language model 3D-parallelism training

Apache License 2.0

1.14k stars 107 forks source link

Add check for model gradient in DDP #14

Closed NouamaneTazi closed 8 months ago