search

google / gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.
Apache License 2.0
5.76k stars 487 forks source link

Fix DASSERT - TiledBatch requires at least 2 vectors. #253

Closed copybara-service[bot] closed 3 weeks ago

copybara-service[bot] commented 3 weeks ago

Fix DASSERT - TiledBatch requires at least 2 vectors.

Also use shorthand for weight types.