config across NVIDIA GPU & AWS Chips + neuron script fix

awslabs / fmbench-orchestrator

Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously

2 stars 2 forks source link

Closed madhurprash closed 3 weeks ago

madhurprash commented 3 weeks ago

This PR contains:

config file for llama3.1 70b across g5, g6, g6e, p4de, inf2 and trn1 instances
Neuron start up script fix - faced a bug regarding "ec2_user" not found. Changed to ubuntu and tested with both inf2 and trn1.