neondatabase / autoscaling

Postgres vertical autoscaling in k8s
Apache License 2.0
152 stars 21 forks source link

neonvm: Add neonvm-runner image loader #857

Closed sharnoff closed 6 months ago

sharnoff commented 6 months ago

When rolling out an update to neonvm, we currently don't pre-load the neonvm-runner images. This has a couple effects:

  1. For a brief period, new VM runner pods are additionally blocked on pulling the runner image (which can take a while); and
  2. If there's issues with pulling the runner image, we only detect that once we're actually attempting to use it.

This PR adds a new daemonset to just keep the neonvm-runner image around on each node. Before rolling out a neonvm update, we can update the runner image in the daemonset to make sure that the new image is loaded on all the nodes.

Part of neondatabase/cloud#11232

shayanh commented 6 months ago

I saw that the CI has failed because of a namespace error but I think it should a small issue.