search

HomebrewNLP / Olmax

HomebrewNLP in JAX flavour for maintable TPU-Training
BSD 2-Clause "Simplified" License
45 stars 5 forks source link

feat(optimizer): use normalized rmsprop #64

Closed ClashLuke closed 1 year ago

ClashLuke commented 1 year ago

horrific performance