Code to train llama on tpus?

openlm-research / open_llama

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

Apache License 2.0

7.27k stars 370 forks source link

Closed kathir-ks closed 1 week ago

kathir-ks commented 5 months ago

Where is the code to train llama on tpu's?

mahavatara commented 4 months ago

Where is all the code actually, I don't see anything!