search

young-geng / EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
Apache License 2.0
2.33k stars 247 forks source link

Missing config for Open LLaMA 3B #97

Open jcole75 opened 9 months ago

jcole75 commented 9 months ago

I can't find any instructions or config for fine tuning Open LLaMA 3B. It seems that the EasyLM doesn't support the 3b config option. Am I missing something?

young-geng commented 9 months ago

EasyLM does support OpenLLaMA 3B, and in fact this is what we used to train it. You can just use the 3b option in load_llama_config to use it.