huggingface / nanotron

Minimalistic large language model 3D-parallelism training
Apache License 2.0
1.14k stars 107 forks source link

[Bug] Not saving `lm_head` in checkpoint #82

Closed xrsrke closed 7 months ago

xrsrke commented 7 months ago

Updated: Not a bug!