Multi host TPU training

young-geng / EasyLM

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

Apache License 2.0

2.33k stars 247 forks source link

Closed kathir-ks closed 1 month ago

kathir-ks commented 5 months ago

How to train an LLM using EasyLM on multiple tpus in a distributed manner?