admiraltyio / admiralty

A system of Kubernetes controllers that intelligently schedules workloads across clusters.
https://admiralty.io
Apache License 2.0
673 stars 87 forks source link

CSIStorageCapacity no long supported from Kubernetes 1.27 #171

Closed nicksome168 closed 10 months ago

nicksome168 commented 1 year ago

Scenario

Problem Description

After I created Kubernetes Jobs in the management cluster, the proxy pods are stuck in the everlasting Pending state. I checked the admiralty-multicluster-scheduler-proxy-scheduler deployment and seems like there are missing rbac rules.

The errors from the logs from admiralty-multicluster-scheduler-proxy-scheduler deployment

W0627 17:30:23.203566       1 reflector.go:324] k8s.io/client-go@v0.23.3/tools/cache/reflector.go:167: failed to list *v1beta1.CSIStorageCapacity: the server could not find the requested resource
E0627 17:30:23.203580       1 reflector.go:138] k8s.io/client-go@v0.23.3/tools/cache/reflector.go:167: Failed to watch *v1beta1.CSIStorageCapacity: failed to list *v1beta1.CSIStorageCapacity: the server could not find the requested resource

I follow the exact installation steps from the example and stuck at this step:

for i in $(seq 1 10)
do
  cat <<EOF | kubectl --context kind-cd apply -f -
apiVersion: batch/v1
kind: Job
metadata:
  name: global-$i
spec:
  template:
    metadata:
      annotations:
        multicluster.admiralty.io/elect: ""
    spec:
      containers:
      - name: c
        image: busybox
        command: ["sh", "-c", "echo Processing item $i && sleep 5"]
        resources:
          requests:
            cpu: 100m
      restartPolicy: Never
EOF
done
nicksome168 commented 1 year ago

@adrienjt Just a kind reminder that the Quick Start example should be updated. I already ran into 3 issues (this one, the M1 issue, and kind's Pod errors due to too many open files) that are not covered in the docs...

nicksome168 commented 1 year ago

The Quick Start docs should specify image version --image kindest/node:v1.26.6 in kind create as CSIStorageCapacity v1beta1 is no longer supported since v1.27. The latest version of kind is using v1.27.

nicksome168 commented 11 months ago

What does the roadmap for supporting Kubernetes 1.27 look like?

aynkodexa commented 11 months ago

There is no current workaround for this CSIStorageCapacity issue? @nicksome168

nicksome168 commented 10 months ago

There is no current workaround for this CSIStorageCapacity issue? @nicksome168

unfortunately not that im aware of. Perhaps the new release supports 1.27. I haven't looked into it yet.

adrienjt commented 10 months ago

Perhaps the new release supports 1.27.

It does.