google / gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.
Apache License 2.0
5.9k stars 499 forks source link

Add per-thread even_odd storage for #166. #173

Closed copybara-service[bot] closed 4 months ago

copybara-service[bot] commented 4 months ago

Add per-thread even_odd storage for #166.

Also inline ProjQ and ProjKV lambdas, add missing includes/deps for ops_test.