search

huggingface / nanotron

Minimalistic large language model 3D-parallelism training
Apache License 2.0
1.14k stars 107 forks source link

Add document #26

Closed xrsrke closed 8 months ago

3outeille commented 8 months ago

LGTM

NouamaneTazi commented 8 months ago

I was thinking this could go better in the wiki https://github.com/huggingface/nanotron/wiki ? 🤔 Wdyt

xrsrke commented 8 months ago

@NouamaneTazi if we put it in the repo, the doc could be contributed to by the community. This makes more sense, I think.