search

google / gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.
Apache License 2.0
5.9k stars 499 forks source link

Generic MHA/MQA/GQA implementation #195

Closed copybara-service[bot] closed 3 months ago

copybara-service[bot] commented 3 months ago

Generic MHA/MQA/GQA implementation