Checkpoints for instruction-tuned model

allenai / OLMo

Modeling, training, eval, and inference code for OLMo

https://allenai.org/olmo

Apache License 2.0

4.24k stars 399 forks source link

Checkpoints for instruction-tuned model #553

Closed alexnikulkov closed 3 months ago

alexnikulkov commented 3 months ago

🚀 The feature, motivation and pitch

Could you please add the intermediate checkpoints for the instruction-tuned model? Thanks!

Alternatives

No response

Additional context

No response

natolambert commented 3 months ago

Hey @alexnikulkov, thanks for the note. We don't have these for the original instruct models, but I'm starting OLMo 1.7 instruct this week and will add them for future models.