aws-samples / foundation-model-benchmarking-tool

Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.
MIT No Attribution
151 stars 21 forks source link

Add Python Script to Retrieve SageMaker Endpoint Invocation and Utilization Metrics #107

Closed dheerajoruganty closed 1 month ago

dheerajoruganty commented 1 month ago

Description of changes:

This pull request introduces a Python script that retrieves invocation metrics for a specified SageMaker endpoint within a given time range. The function get_endpoint_metrics allows users to get a Dataframe with metrics such as Invocations, Invocation4XXErrors, and Invocation5XXErrors, CPU Utilization, and Memory Utilization from CloudWatch.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.