search

allenai / OLMo

Modeling, training, eval, and inference code for OLMo
https://allenai.org/olmo
Apache License 2.0
4.2k stars 392 forks source link

Read and use tokenizer identifier from config #611

Closed 2015aroras closed 4 weeks ago

2015aroras commented 4 weeks ago

Correction of https://github.com/allenai/OLMo/pull/610, tested on a 1.7 7B checkpoint.