Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
154
stars
22
forks
source link
llama3-8b-instruct inf2 config file #74
Closed
madhurprash closed 2 months ago
Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.