Inveniem / nextcloud-azure-aks

Azure Container Resource Toolkit for Nextcloud
GNU Affero General Public License v3.0
11 stars 9 forks source link

[ITSA-1478] Prefer Scheduling Burstable Workloads on Burstable Nodes (Take 2) #18

Closed GuyPaddock closed 1 year ago

GuyPaddock commented 1 year ago

This expands the pods that can be scheduled on burstable nodes to include ClamAV and Nextcloud's standard Cron task. The Apache and FPM images already support being burstable.

Several of these pods already had tolerations to be scheduled on burstable nodes, but Kubernetes would only do that as a last resort. This conveys to the scheduler that these pods actually prefer that.

Unfortunately, there is not a way to use a taint as a matching criterion, so we had to duplicate the taint as a label on the node pool. This was added with a command like the following:

az aks nodepool update \
  --resource-group RESOURCE-GROUP \
  --cluster-name CLUSTER-NAME \
  --name NODE-POOL-NAME \
  --labels inveniem.com/workload-type=burstable

The previous version of this PR had a commit with the wrong title. It was re-rolled.