search

young-geng / EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
Apache License 2.0
2.33k stars 247 forks source link

Does EasyLM work for LLama-2? #99

Open Eichhof opened 9 months ago

Eichhof commented 9 months ago

Hello

Does this EasyLM also support fine-tuning LLama-2 7B on TPUs? I could only find support for Llama v1 but not v2. In particular, does the following script also work for v2? https://github.com/young-geng/EasyLM/blob/main/EasyLM/models/llama/convert_easylm_to_hf.py