Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
197
stars
31
forks
source link
Add concurrency=3 for g6e instance configs #209
Closed
dheerajoruganty closed 1 month ago
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.