search

OpenNMT / CTranslate2

Fast inference engine for Transformer models
https://opennmt.net/CTranslate2
MIT License
3.44k stars 305 forks source link

Add gemma2 support #1735

Closed Theodotus1243 closed 1 month ago

Theodotus1243 commented 5 months ago

It should be a minor extension It shares gemma and llama features And also a powerful model by itself MMLU 71

paper model config

BBC-Esq commented 3 months ago

Is gemma2 supported yet??

Theodotus1243 commented 1 month ago

Done here https://github.com/OpenNMT/CTranslate2/pull/1772