search

huggingface / nanotron

Minimalistic large language model 3D-parallelism training
Apache License 2.0
1.14k stars 107 forks source link

[Refactor] Refactor module names / module ids usage #18

Open NouamaneTazi opened 8 months ago

NouamaneTazi commented 8 months ago

We can use module ids smartly and refactor calls like get_full_name_from_module_id_to_prefix in here