armadaproject / armada

A multi-cluster batch queuing system for high-throughput workloads on Kubernetes.
https://armadaproject.io
Apache License 2.0
436 stars 128 forks source link

Add support for mixed pool clusters #3770

Closed JamesMurkin closed 3 days ago

JamesMurkin commented 6 days ago

Currently an executor (k8s cluster) must belong to a pool.

This can be quite restricting if you have several nodes, all of which you want to be in their own pools. As you have to build a cluster for each group of nodes

With this change we are making it so a Node belongs to a pool (marked via label) - and defaulting to the cluster pool

As part of this change I've also removed the minimumJobSize functionality as it is unused