search

keeeeenw / MicroLlama

Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
Apache License 2.0
112 stars 5 forks source link

training code #3

Closed fakerybakery closed 4 months ago

fakerybakery commented 4 months ago

hi, thanks for releasing! i noticed you mentioned in your readme you made several modifications to tinyllama, will these be released? thanks!

fakerybakery commented 4 months ago

never mind, found your fork https://github.com/keeeeenw/TinyLlama, sorry about that!