search

google / maxtext

A simple, performant and scalable Jax LLM!
Apache License 2.0
1.39k stars 247 forks source link

Add Llama2 7B, 13B high performance training configs #726

Closed raymondzouu closed 3 weeks ago

raymondzouu commented 4 weeks ago

Add Llama2 7B, 13B high performance training configs. Perf numbers can be found in http://shortn/_yDgzqXMQDf