search

allenai / OLMo

Modeling, training, eval, and inference code for OLMo
https://allenai.org/olmo
Apache License 2.0
4.2k stars 392 forks source link

MoE #639

Open Muennighoff opened 1 week ago

Muennighoff commented 1 week ago

Replaces https://github.com/allenai/OLMo/pull/541