openlm-research / open_llama

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
Apache License 2.0
7.27k stars 370 forks source link

Call for 300B token checkpoint for the OpenLLaMA 7B model #92

Open xinghuang2050 opened 10 months ago

xinghuang2050 commented 10 months ago

Dear Open Llama authors,

Thank you for your dedication in releasing the OpenLLaMA model and checkpoints to the community. The checkpoints have been of great value for testing model in training process.

Unfortunately, we have noticed that the checkpoints are no longer available on Hugging Face. Would it be possible to provide guidance on how to obtain the OpenLLaMA 7B model at checkpoints for 200B, 300B, and 400B tokens?

Thank you in advance for your assistance