Toy LLM

ToyLLM is a simple language model that can be used to generate text. It is based on the GPT-2 model.

Acknowledgements

The project is highly inspired by the following projects:

• rasbt/LLMs-from-scratch
• neelnanda-io/TransformerLens