search

HomebrewNLP / Olmax

HomebrewNLP in JAX flavour for maintable TPU-Training
BSD 2-Clause "Simplified" License
45 stars 5 forks source link

perf(optimizer): use adam+shampoo #62

Closed ClashLuke closed 2 years ago

ClashLuke commented 2 years ago

https://twitter.com/_clashluke/status/1535994026876252160