awslabs / fmbench-orchestrator

Run FMBench simultaneously across multiple Amazon EC2 machines to benchmark an FM across multiple serving stacks simultaneously
https://aws-samples.github.io/foundation-model-benchmarking-tool/
2 stars 2 forks source link

Add Handling when Create EC2 call fails #6

Open dheerajoruganty opened 1 month ago

dheerajoruganty commented 1 month ago

Description:

When making an API call to create an EC2 instance, the request may fail due to various reasons such as:

Currently, there is no error handling mechanism in place to gracefully handle such failures. If an instance creation request fails, it causes the process to stop unexpectedly. We need to implement error handling logic to skip the failed instance creation attempt and proceed to the next one.

Steps to Reproduce:

  1. Call the EC2 API with invalid or incorrect parameters.
  2. If a service quota limit is reached, the process halts with an error message.

Expected Behavior:

Possible Solutions:

Relevant Code/Section:

Add error handling in the code section responsible for making EC2 instance creation API calls.