openedx / openedx-k8s-harmony

A Prototype Helm Chart for deploying multiple Open edX instances (via Tutor) onto a cluster.
GNU Affero General Public License v3.0
10 stars 14 forks source link

Karpenter? #7

Closed bradenmacdonald closed 6 months ago

bradenmacdonald commented 1 year ago

https://github.com/lpm0073/cookiecutter-openedx-devops uses Karpenter to optimize the scheduling of k8s nodes at the cloud provider (e.g. AWS EC2 spot instances) to reduce costs of the cluster.

Is that in scope for this project for now, or do we want to stick to things that are provisioned within the cluster itself?

jfavellar90 commented 1 year ago

As @lpm0073 mentioned in the meeting, adding Karpenter requires the creation of a few entities in the cloud provider (AWS) to allow the cluster to interact with different cloud services via roles. Additionally, this service is only supported for AWS for now. The same applies to cluster-autoscaler tool, however, this one offers support for more cloud providers.

lpm0073 commented 1 year ago

the Karpenter installation is segregated into a separate Terraform module in the Cookiecutter, see Terraform/Karpenter.

You can probably copy-paste it nearly verbatim, but summarizing the resources that are required:

bradenmacdonald commented 1 year ago

Status: I would consider this a low priority issue for now because it mostly takes place outside of the helm chart.

I propose that the scope of this issue be: to test Lawrence's Karpenter integration and document how it can be used with this chart, for those who want to use it.

antoviaque commented 1 year ago

Note from the meeting - this work will be dependent on the work from @lpm0073 in https://github.com/openedx/tutor-contrib-multi/issues/3

felipemontoya commented 1 year ago

@lpm0073 we are looking at delegating this to someone else, would you agree?

lpm0073 commented 1 year ago

@felipemontoya i'll follow up with you via DM. i wasn't aware of anything pending nor ongoing w Karpenter. it's been nearly two months since i pushed my code. since then i haven't followed any ongoing dialogue in this project.

felipemontoya commented 1 year ago

For this cycle of review @jfavellar90 was on vacations so he will pick it up once he comes back

gabor-boros commented 6 months ago

Closing as the related PR is already merged.