Fix RoPE and RMS issue - Githubissues

srush / llama2.rs

A fast llama2 decoder in pure Rust.

MIT License

1.01k stars 56 forks source link

Closed srush closed 1 year ago

srush commented 1 year ago

Fixes two subtle issues with the original code. These seemingly came from llama2.c