Add example for training small LLM

[duncantech]

📚 Documentation

Create an example on how to train a small LLM.

Add it to the examples directory here: https://github.com/pytorch/xla/tree/master/examples

[bhavyashahh]

/assigntome

[duncantech]

@bhavyashahh We haven't heard an update on this in a bit and just wondering if you're still working on it?

[bhavyashahh]

@duncantech I want to ask about the expectation of the llm training example, does train_decoder_only_base.py not serve the purpose of the training script? Is there a requirement of using any open source llm, prepare data, train a few steps and predict ?

[duncantech]

You can use any open source LLM but we wanted to have more than one sample