search

huggingface / nanotron

Minimalistic large language model 3D-parallelism training
Apache License 2.0
1.14k stars 107 forks source link

fix fan_in computation for bias in mamba #117

Closed 3outeille closed 6 months ago