palantir / k8s-spark-scheduler

A Kubernetes Scheduler Extender to provide gang scheduling support for Spark on Kubernetes
Apache License 2.0
175 stars 43 forks source link

Compatibility with K8S 1.25 #242

Open nshores opened 1 year ago

nshores commented 1 year ago

spark-scheduler is using an an outdated version client-go which calls api/policy/v1beta1/PodDisruptionBudget. This is a breaking change in K8S 1.25, and stops the scheduler from functioning.

https://kubernetes.io/docs/reference/using-api/deprecation-guide/#poddisruptionbudget-v125

Here is what the scheduler logs look like

 kube-scheduler I0314 18:39:34.199516       1 reflector.go:160] Listing and watching *v1beta1.PodDisruptionBudget from k8s.io/client-go/informers/factory.go:133                       │
│ kube-scheduler E0314 18:39:34.201584       1 reflector.go:125] k8s.io/client-go/informers/factory.go:133: Failed to list *v1beta1.PodDisruptionBudget: the server could not find the  │
│ requested resource

I've created a #241 PR to fix this issue by bumping the K8S dependencies to work on 1.25 and above. I welcome any feedback or suggestions to get it merged.