Open josephjnatale opened 1 year ago
pahud
commented
1 year ago According to the doc
All Amazon EKS AMIs don't currently support the g5g and mac families.
I guess it's not supported yet. But I am interested to know your use case. Why you'd like to use g5g to run Amazon EKS nodegroup? What kind of the workload are you running in k8s?
josephjnatale
commented
1 year ago I am running an image Inferencing model in EKS and I'm looking to have the most cost effective instance type with a GPU. The g5g is about 20% cheaper than the g4dn which I'm currently using. I tried using the inferentia instance class but unfortunately only inf1 is available in us-west-2 currently, and I was not able to get the same performance per dollar with our workload.
chulkilee
commented
1 month ago Probably this is blocked by https://github.com/awslabs/amazon-eks-ami/issues/853 ?
See also https://docs.aws.amazon.com/eks/latest/APIReference/API_Nodegroup.html
Describe the feature
Using the aws-eks library it would be great if I was able to create a nodeGroup with a Graviton GPU instance like the g5g class. However, the NodegroupAmiType does not support AL2_ARM_64_GPU only AL2_ARM_64 which gets denied when trying to synth cdk. If I don't specify the amiType it defaults to AL2_x86_64_GPU and errors out that the g5g.xlarge is not a valid instance type for the requested amiType.
Use Case
To create a nodeGroup with a g5g instance type
Proposed Solution
add support for AL2_ARM_64_GPU to the NodegroupAmiType enum.
Other Information
No response
Acknowledgements
CDK version used
2.87.0
Environment details (OS name and version, etc.)
Mac os 12.4