Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

aws-eks: Support AL2_ARM_64_GPU NodeGroupAmiType #26354

Open
2 tasks
josephjnatale opened this issue Jul 13, 2023 · 3 comments
Open
2 tasks

aws-eks: Support AL2_ARM_64_GPU NodeGroupAmiType #26354

josephjnatale opened this issue Jul 13, 2023 · 3 comments
Labels
@aws-cdk/aws-eks Related to Amazon Elastic Kubernetes Service effort/medium Medium work item – several days of effort feature-request A feature should be added or improved. p2

Comments

@josephjnatale
Copy link

Describe the feature

Using the aws-eks library it would be great if I was able to create a nodeGroup with a Graviton GPU instance like the g5g class. However, the NodegroupAmiType does not support AL2_ARM_64_GPU only AL2_ARM_64 which gets denied when trying to synth cdk. If I don't specify the amiType it defaults to AL2_x86_64_GPU and errors out that the g5g.xlarge is not a valid instance type for the requested amiType.

Use Case

To create a nodeGroup with a g5g instance type

Proposed Solution

add support for AL2_ARM_64_GPU to the NodegroupAmiType enum.

Other Information

No response

Acknowledgements

  • I may be able to implement this feature request
  • This feature might incur a breaking change

CDK version used

2.87.0

Environment details (OS name and version, etc.)

Mac os 12.4

@josephjnatale josephjnatale added feature-request A feature should be added or improved. needs-triage This issue or PR still needs to be triaged. labels Jul 13, 2023
@github-actions github-actions bot added the @aws-cdk/aws-eks Related to Amazon Elastic Kubernetes Service label Jul 13, 2023
@pahud pahud self-assigned this Jul 13, 2023
@pahud
Copy link
Contributor

pahud commented Jul 13, 2023

According to the doc

All Amazon EKS AMIs don't currently support the g5g and mac families.

I guess it's not supported yet. But I am interested to know your use case. Why you'd like to use g5g to run Amazon EKS nodegroup? What kind of the workload are you running in k8s?

@pahud pahud removed their assignment Jul 13, 2023
@pahud pahud added response-requested Waiting on additional info and feedback. Will move to "closing-soon" in 7 days. p2 effort/medium Medium work item – several days of effort and removed needs-triage This issue or PR still needs to be triaged. labels Jul 13, 2023
@josephjnatale
Copy link
Author

I am running an image Inferencing model in EKS and I'm looking to have the most cost effective instance type with a GPU. The g5g is about 20% cheaper than the g4dn which I'm currently using. I tried using the inferentia instance class but unfortunately only inf1 is available in us-west-2 currently, and I was not able to get the same performance per dollar with our workload.

@github-actions github-actions bot removed the response-requested Waiting on additional info and feedback. Will move to "closing-soon" in 7 days. label Jul 14, 2023
@chulkilee
Copy link

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
@aws-cdk/aws-eks Related to Amazon Elastic Kubernetes Service effort/medium Medium work item – several days of effort feature-request A feature should be added or improved. p2
Projects
None yet
Development

No branches or pull requests

3 participants