search

aws-samples / foundation-model-benchmarking-tool

Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
https://aws-samples.github.io/foundation-model-benchmarking-tool/
MIT No Attribution
197 stars 31 forks source link

write multiple to s3 bug fix in evals #195

Closed madhurprash closed 2 months ago

madhurprash commented 2 months ago

This PR contains the following changes:

  1. Changing the write multiple to s3 function call while writing eval files to s3
  2. minor tweaks to predict + run inference to handle request exceptions without stopping the fmbench test run