search

aws-samples / foundation-model-benchmarking-tool

Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
MIT No Attribution
151 stars 21 forks source link

gemma support added to FMBench #116

Closed madhurprash closed 3 weeks ago

madhurprash commented 3 weeks ago

This PR contains as follows:

  1. Contains the config file for Gemma 2b
  2. Working version for Gemma 2b tokenizer support using the latest version of transformers
  3. prompt template for Gemma 2b