search

aws-samples / foundation-model-benchmarking-tool

Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
https://aws-samples.github.io/foundation-model-benchmarking-tool/
MIT No Attribution
182 stars 27 forks source link

cloudformation template generalized for gov cloud #129

Closed madhurprash closed 3 months ago

madhurprash commented 3 months ago

This PR contains the following changes:

  1. Condition addition in template.yml to support gov cloud CFT stack deployments. If the partition is in aws-us-gov, the github repository will not be cloned to the SM notebook instance
  2. If the region is anywhere out of the gov cloud, the github repository will by default be cloned within the SM notebook instance
  3. This template is successfully tested with titan on bedrock in gov cloud as well as llama2-7b quick in a general us-east-1 region

To Do:

  1. Need to create a new build with this template to handle the .keep error
  2. update the launch stack button template using this new cft template