huggingface / nanotron

Minimalistic large language model 3D-parallelism training
Apache License 2.0
1.14k stars 107 forks source link

Add converter (HF <-> Nanotron) for Mamba #103

Closed 3outeille closed 4 months ago

3outeille commented 6 months ago
3outeille commented 6 months ago

should be done now @NouamaneTazi can be merged

3outeille commented 5 months ago

going to split this PR into multiple tiny so that this one only focus on converter