Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
197
stars
31
forks
source link
make config file naming convention consistent for llama3.1 8b/70b on g6e #221
Closed
madhurprash closed 1 month ago
Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.