Disk partition is too low on vSphere clusters in wallaby workload clusters

[njuettner]

I got paged because the diskspace on the root partition was too low. If the customer runs Java applications there's already a super high chance that this might kill nodes.

From talking with @vxav it should already be increased to 64GB.

Could you please investigate why this hasn't been adjusted?

Cluster which has been affected : wallaby/plant-cassino-dev

plant-cassino-dev-worker-x76tj-7hnn4 ~ # df -h
Filesystem                                                                    Size  Used Avail Use% Mounted on
devtmpfs                                                                      4.0M     0  4.0M   0% /dev
tmpfs                                                                         7.9G     0  7.9G   0% /dev/shm
tmpfs                                                                         3.2G   18M  3.2G   1% /run
/dev/sda9                                                                      17G   15G  1.6G  91% /
sysext                                                                        7.9G   12K  7.9G   1% /usr

Additional information on that:

https://kubernetes.slack.com/archives/CKFGK3SSD/p1622112033033700?thread_ts=1622108128.030700&cid=CKFGK3SSD

[vxav]

Actually nevermind the linked clone thing https://github.com/kubernetes-sigs/cluster-api-provider-vsphere/blob/main/config/default/crd/bases/infrastructure.cluster.x-k8s.io_vspheremachinetemplates.yaml#L833-L834