google / gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.
Apache License 2.0
5.94k stars 502 forks source link

Fix numerical issue in Softcap by subtracting max. #235

Closed copybara-service[bot] closed 3 months ago

copybara-service[bot] commented 3 months ago

Fix numerical issue in Softcap by subtracting max.

Also update test threshold.