search

HomebrewNLP / Olmax

HomebrewNLP in JAX flavour for maintable TPU-Training
BSD 2-Clause "Simplified" License
45 stars 5 forks source link

More normv2 #92

Closed ClashLuke closed 1 year ago

ClashLuke commented 1 year ago

More-Norm (purple) has 1% lower loss than baseline (green) grafik