aws-samples / foundation-model-benchmarking-tool

Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
https://aws-samples.github.io/foundation-model-benchmarking-tool/
MIT No Attribution
202 stars 31 forks source link

FMBench orchestrator bedrock + sagemaker files for llama3.1 8b #239

Closed madhurprash closed 1 week ago

madhurprash commented 1 week ago

Issue #, if available:

Description of changes:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.