search

aws-samples / foundation-model-benchmarking-tool

Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
https://aws-samples.github.io/foundation-model-benchmarking-tool/
MIT No Attribution
182 stars 27 forks source link

clean up analytics, create documentation for it #182

Closed madhurprash closed 1 month ago

madhurprash commented 1 month ago

This PR contains the following changes:

  1. Changes to analytics.py to contain concurrency threshold as a command line arg, and other small changes.
  2. Changes to the sagemaker rpm file - dynamically adjust the font size as the number of columns and rows increase (example given in the documentation)
  3. Add documentation for customers to run analytics.py with their own result folders. Image with masked model name and hidden cost estimates for each rpm level.