search

tairov / llama2.mojo

Inference Llama 2 in one file of pure 🔥
https://www.modular.com/blog/community-spotlight-how-i-built-llama2-by-aydyn-tairov
MIT License
2.09k stars 140 forks source link

add tokenizer from llama2.py #3

Closed g1y5x3 closed 1 year ago

g1y5x3 commented 1 year ago

Tested on my Ubuntu 22.04 laptop, should be able to fix #2 Screenshot from 2023-09-11 21-24-45

tairov commented 1 year ago

Ah, my bad.. I was so in context , and completely forgot about this 😀 Thanks for PR 👍