search

awslabs / fmbench-orchestrator

Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously
https://aws-samples.github.io/foundation-model-benchmarking-tool/
2 stars 2 forks source link

Config example has non-existent configs referenced #29

Open jimburtoft opened 21 hours ago

jimburtoft commented 21 hours ago

Some of the config files in the example llama3.1-70b-g5-g6-g6e-trn-inf-p4de.yml no longer exist on the current fmbench project. I found two, but I didn't verify all of them.

https://github.com/awslabs/fmbench-orchestrator/blob/569134cb94befc2da7bdd70a8fef14b3d9755007/configs/llama3.1/70b/llama3.1-70b-g5-g6-g6e-trn-inf-p4de.yml#L96

https://github.com/awslabs/fmbench-orchestrator/blob/569134cb94befc2da7bdd70a8fef14b3d9755007/configs/llama3.1/70b/llama3.1-70b-g5-g6-g6e-trn-inf-p4de.yml#L146