search

awslabs / fmbench-orchestrator

Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously
https://aws-samples.github.io/foundation-model-benchmarking-tool/
2 stars 2 forks source link

Add support for Intel and AMD with AL2023 #24

Closed dheerajoruganty closed 2 weeks ago

dheerajoruganty commented 2 weeks ago

Tested end to end with m7a.24xlarge, and can confirm that these configs work.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.