issues
search
google
/
gemma.cpp
lightweight, standalone C++ inference engine for Google's Gemma models.
Apache License 2.0
5.9k
stars
499
forks
source link
Generic MHA/MQA/GQA implementation
#195
Closed
copybara-service[bot]
closed
3 months ago
copybara-service[bot]
commented
3 months ago
Generic MHA/MQA/GQA implementation
Generic MHA/MQA/GQA implementation