feat: ec2 instance selection

openfoundry-ai / model_manager

Model Manager is a Python package that simplifies the process of deploying an open source AI model to your own cloud.

https://www.openfoundry.ai

MIT License

290 stars 18 forks source link

feat: ec2 instance selection #5

Closed arthurchi93 closed 7 months ago

arthurchi93 commented 7 months ago

Calls AWS api to retrieve list of EC2 instances available to Sagemaker for inference. Includes cleanup for singleton session and console. Requires ServiceQuotasReadOnlyAccess (or ServiceQuotaFullAccess) policy on IAM user