FMBench to support an REST Predictor

aws-samples / foundation-model-benchmarking-tool

Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.

MIT No Attribution

154 stars 22 forks source link

Closed madhurprash closed 2 months ago

madhurprash commented 2 months ago

To add support for an REST predictor to run inferences on a model deployed out of sagemaker/bedrock