search

rasbt / LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
https://www.amazon.com/Build-Large-Language-Model-Scratch/dp/1633437167
Other
32.84k stars 3.94k forks source link

Any plan to introduce kv cache or something alike? #331

Closed npuichigo closed 2 months ago

npuichigo commented 2 months ago

Thank you for this fantastic book. I'd like to know if there's any further plan to introduce some popular topics like kv cache? By the way, what's the current progress of this book.