Move kGriffinLayers into ConfigNoSSM, set kGemmaLayers directly

google / gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.

Apache License 2.0

5.76k stars 487 forks source link

Closed copybara-service[bot] closed 2 weeks ago

copybara-service[bot] commented 2 weeks ago

Move kGriffinLayers into ConfigNoSSM, set kGemmaLayers directly

For regular (non-SSM) Gemma models, kGriffinLayers is by definition always zero and kGemmaLayers is just the number of layers.