search

srush / llama2.rs

A fast llama2 decoder in pure Rust.
MIT License
1.01k stars 56 forks source link

Static Typing and Sizes #3

Closed srush closed 1 year ago

srush commented 1 year ago

Switch to a variant that statically types all the sizes to take advantage of rust.