search

kubernetes / kops

Kubernetes Operations (kOps) - Production Grade k8s Installation, Upgrades and Management
https://kops.sigs.k8s.io/
Apache License 2.0
15.95k stars 4.65k forks source link

[question] Can we use different AMI images for different instance arch in mixed IGs? #16100

Open shapirus opened 12 months ago

shapirus commented 12 months ago

There's a scalar field to specify the image AMI for an instance group: .spec.image

However, it is sometimes desirable to run instances of different architectures (arm64 + amd64) in the same instance group, using, for example, the spot mixedInstancesPolicy configuration.

Obviously, this will fail, since all the instance types must match the specified AMI architecture.

Part of the documentation at https://kops.sigs.k8s.io/instance_groups/#spotinstancepools suggests that there might be something of interest:

The Spot pools are determined from the different instance types in the Overrides array of LaunchTemplate. Default if not set is 2.

However I found no further mention of how to configure this Overrides array, which apparently can be used to set AMIs for each specific instance type (as described in https://aws.amazon.com/blogs/compute/supporting-aws-graviton2-and-x86-instance-types-in-the-same-auto-scaling-group/).

Is there any workaround?

hakman commented 12 months ago

Hi @shapirus. At the moment it's not possible to use mixed arch. It's been discussed several times, but it's not something easy to add and would require many changes that are not planned at the moment. /kind feature

jclegras commented 9 months ago

Hello, is there anything new here please ?

k8s-triage-robot commented 6 months ago

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

shapirus commented 6 months ago

/remove-lifecycle stale

k8s-triage-robot commented 3 months ago

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

k8s-triage-robot commented 2 months ago

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

You can:

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle rotten

shapirus commented 2 months ago

/remove-lifecycle rotten

maybe one day it gets some attention, so let's keep it open.