google / gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.
Apache License 2.0
5.8k stars 491 forks source link

Major duplicated code reduction in test/benchmarks #240

Closed copybara-service[bot] closed 1 month ago

copybara-service[bot] commented 1 month ago

Major duplicated code reduction in test/benchmarks

Helper functions to tokenize/wrap Move LayersOutputFunc into RuntimeConfig AcceptFunc passes the probability Implement StringFromType using the parser, and verify results match