search

kedacore / governance

Governance of KEDA
Apache License 2.0
8 stars 10 forks source link

Provide self-hosted ARM runner #12

Closed tomkerkhove closed 2 years ago

tomkerkhove commented 3 years ago

ARM is becoming a major aspect for workloads such as edge and we've received requests to provide an ARM-based image (https://github.com/kedacore/keda/issues/779).

GitHub Actions does not provide an ARM runner, but CNCF allows us to request a bare metal machine (link) on which we could run a self-hosted runner.

If we want to, we can request one but the following requirements apply:

  • Code being run must be 100 percent open source and must not include any sensitive data.
  • Testing should involve cloud native computing, meaning containerization, microservices, orchestration or some combination.
  • You agree to write a blog post later about your experiences with the CIL.
  • Priority is given first to CNCF projects, then to developers from CNCF member companies and then to any open source developer.
  • Resources are limited so we may ask you to reduce your usage when there is high demand for the available credits from Equinix Metal ($1,000,000 per year).

What do you think?

zroubalik commented 3 years ago

This is looking good, I think that we follow all the requirements, so there shouldn't be a problem.

jeffhollan commented 3 years ago

Issued request here https://github.com/cncf/cluster/issues/163

tomkerkhove commented 3 years ago

Any update on this @jeffhollan ?

JorTurFer commented 2 years ago

Any update? ARM is a reality in AWS with Graviton nodes. We are thinking in migrate our workloads to ARM because Graviton saves a lot of money for example. Of course, having more than one nodepools we could have also AMD nodes, but it would be amazing if KEDA runs on ARM too

jeffhollan commented 2 years ago

Any update on this @jeffhollan ?

Yes we have the infra issued from CNCF, would need someone to wire up that infra with GitHub Actions runners and include in our e2e tests (as well as make any adjustments needed to make it work well)

tomkerkhove commented 2 years ago

Feel free to send me the details and I can take a look!

JorTurFer commented 2 years ago

Nice!!! Supporting ARM could be an incredible feature :) Let me know if I can help in anything there

tomkerkhove commented 2 years ago

Self-hosted ARM64 runner for GitHub Actions is available.

runs-on: keda-arm64

I will add the SSH keys to 1Password later on.

JorTurFer commented 2 years ago

Could this machine be used also during e2e test? I mean, maybe we should deploy KEDA and run e2e tests in both archs, AMD and ARM

tomkerkhove commented 2 years ago

We'll use it for everything, see https://github.com/kedacore/keda/issues/779

tomkerkhove commented 2 years ago

Since this is a self-hosted agent, we need to install all our pre-requisites on it.

@zroubalik Is this something you want to script that we run on the machine (automatically)?

JorTurFer commented 2 years ago

But we will need a kubernetes cluster with ARM nodes in order to run e2e test there. Maybe we can install a local cluster for that :thinking:

zroubalik commented 2 years ago

That's right, @tomkerkhove do you know how many machines or how big they are? We can run a reduced e2e tests on that, just a smoke check that the build is correct.

tomkerkhove commented 2 years ago

We can setup whatever we want 🤷‍♂️

Let's create issues on our KEDA repo and see what infrastructure needs we have, this one is unrelated to ARM-based cluster.

tomkerkhove commented 2 years ago

It's up and running.