Lllama3 70B on ec2 - Githubissues

aws-samples / foundation-model-benchmarking-tool

Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.

MIT No Attribution

182 stars 27 forks source link

Closed antara678 closed 3 months ago

antara678 commented 3 months ago

Llama 3 70B Config file

Issue #, if available:

Description of changes:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.