search

HomebrewNLP / Olmax

HomebrewNLP in JAX flavour for maintable TPU-Training
BSD 2-Clause "Simplified" License
45 stars 5 forks source link

Looped pool #91

Closed ClashLuke closed 1 year ago

ClashLuke commented 1 year ago

Better than baseline without pooling. grafik

Currently testing pooling.

ClashLuke commented 1 year ago

grafik Pooling doesn't help, but the other things in the PR doe significantly. Might remove pooling later in a cleanup.

ClashLuke commented 1 year ago

lgtm