allenai / OLMo

Modeling, training, eval, and inference code for OLMo
https://allenai.org/olmo
Apache License 2.0
4.24k stars 399 forks source link

remove last name #572

Closed mitchellnw closed 2 months ago

mitchellnw commented 2 months ago

Thanks and sorry! I don't have recollection or information about this initialization and folks at ICLR are asking me about it from reading this code. I think possibly this might be the reference https://arxiv.org/pdf/1908.11365.