LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.34k stars 310 forks source link

Gemma-2 support? #950

Closed pbz134 closed 6 hours ago

pbz134 commented 4 days ago

Hoping for Gemma-2 support soon! :D

jacekpoplawski commented 4 days ago

it has been implemented in llama.cpp today

LostRuins commented 4 days ago

It'll be in the next version, which should be out in less than a week