search

allenai / OLMo

Modeling, training, eval, and inference code for OLMo
https://allenai.org/olmo
Apache License 2.0
4.24k stars 400 forks source link

Add OLMo 1.7-7b README + Config #547

Open 2015aroras opened 3 months ago

dumitrac commented 2 months ago

@2015aroras - do you think that for 1.7 we should have two configs? I understand that training was stopped, config changed, then resumed.

soheeyang commented 2 months ago

Hi, thank you so much for the work! Is there an estimated date of when all the details including the https links of the training data and the data order files are going to be released?

2015aroras commented 2 months ago

@kyleclo @soldni Do you have any updates on the data side?