search

huggingface / nanotron

Minimalistic large language model 3D-parallelism training
Apache License 2.0
1.23k stars 122 forks source link

Refactor `ParallelContext` and some process groups creation #69

Closed NouamaneTazi closed 9 months ago