search

rasbt / LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
https://www.amazon.com/Build-Large-Language-Model-Scratch/dp/1633437167
Other
34.28k stars 4.2k forks source link

Add Llama 3.2 RoPE to CI #391

Closed rasbt closed 1 month ago

rasbt commented 1 month ago

Adds the Llama 3.1 and 3.2 configs to the CI for completeness.