Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
154
stars
22
forks
source link
config files for llama2 7b/13b on inf2 #67
Closed
madhurprash closed 2 months ago
Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.