aws / karpenter-provider-aws

Karpenter is a Kubernetes Node Autoscaler built for flexibility, performance, and simplicity.
https://karpenter.sh
Apache License 2.0
6.73k stars 944 forks source link

Bottlerocket compatibility testing #4105

Open ellistarn opened 1 year ago

ellistarn commented 1 year ago

Karpenter should include bottlerocket AMI testing within scope of it's version compatibility tests.

Good Places to Start

  1. Adding SSM resolution tests to the AMI Test Suite
  2. Adding basic configuration Smoke Tests to the KubeletConfiguraiton Test Suite
bwagner5 commented 1 year ago

We also need a mechanism to make sure settings.kubernetes keys are available in Karpenter when added to Bottlerocket.

Need to support all or most of these as it changes over time: https://github.com/bottlerocket-os/bottlerocket/blob/develop/sources/models/src/lib.rs#L217

Maybe a rust tool that can depend directly on this model lib, or spend some time working on https://github.com/pelletier/go-toml/issues/796

jonathan-innis commented 1 year ago

Adding to this, we need to ensure that all AMIs that are supported for both the standard SSM alias and the GPU-specific SSM alias are resolvable for all K8s versions that we say we support or that we include some mechanism to disable these aliases until they become available.