Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
197
stars
31
forks
source link
bug fix + updated triton vllm config file #200
Closed
madhurprash closed 1 month ago
Issue #, if available:
Description of changes:
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.