search

huggingface / nanotron

Minimalistic large language model 3D-parallelism training
Apache License 2.0
1.23k stars 122 forks source link

Fix the issue of some missing replacements related to 'dpg' and 'para… #22

Closed xrsrke closed 10 months ago

xrsrke commented 10 months ago

Fix the issue of some missing replacements related to 'dpg' and 'parallel_context'