search

awslabs / data-on-eks

DoEKS is a tool to build, deploy and scale Data & ML Platforms on Amazon EKS
https://awslabs.github.io/data-on-eks/
Apache License 2.0
658 stars 223 forks source link

Chore: Kubernetes cluster version upgrades #520

Closed raykrueger closed 4 months ago

raykrueger commented 6 months ago

Description

The EKS cluster versions in various blueprints are getting a bit behind. We should upgrade all of our blueprints to latest (1.29 at the time of this wrting, 1.30 due soon).

Find them is done as possible. Clone the repo and cd to it.

git clone https://github.com/awslabs/data-on-eks.git
cd data-on-eks

In our blueprints the eks_cluster_version is stored in the variables.tf file. There are other notable version references that should get updated as well.

Find clusters with 1.26

$ git grep "1\.26" -- '*.tf'
analytics/terraform/datahub-on-eks/variables.tf:  default     = "1.26"
schedulers/terraform/managed-airflow-mwaa/variables.tf:  default     = "1.26"

Find clusters with 1.27

$ git grep "1\.27" -- '*.tf'
ai-ml/jark-stack/terraform/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2/recommended/image_id --region us-west-2
ai-ml/jupyterhub/variables.tf:  default     = "1.27"
ai-ml/mlflow/variables.tf:  default     = "1.27"
ai-ml/trainium-inferentia/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2/recommended/image_id --region us-west-2
ai-ml/trainium-inferentia/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2-gpu/recommended/image_id --region us-west-2
ai-ml/trainium-inferentia/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2-gpu/recommended/image_id --region us-west-2
ai-ml/trainium-inferentia/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2-gpu/recommended/image_id --region us-west-2
ai-ml/trainium-inferentia/eks.tf:      # aws ssm get-parameters --names /aws/service/eks/optimized-ami/1.27/amazon-linux-2-gpu/recommended/image_id --region us-west-2
analytics/terraform/emr-eks-ack/variables.tf:  default     = "1.27"
analytics/terraform/emr-eks-fargate/variables.tf:  default     = "1.27"
streaming/flink/variables.tf:  default     = "1.27"
streaming/kafka/variables.tf:  default     = "1.27"
streaming/nifi/variables.tf:  default     = "1.27"

And finally, 1.28

$ git grep "1\.28" -- '*.tf'
analytics/terraform/emr-eks-karpenter/variables.tf:  default     = "1.28"
analytics/terraform/spark-k8s-operator/variables.tf:  default     = "1.28"
distributed-databases/pinot/variables.tf:  default     = "1.28"
manjarisri commented 6 months ago

Hello, i have raised a PR for the same PR #523

github-actions[bot] commented 5 months ago

This issue has been automatically marked as stale because it has been open 30 days with no activity. Remove stale label or comment or this issue will be closed in 10 days

github-actions[bot] commented 4 months ago

Issue closed due to inactivity.