openebs-archive / cstor-operators

Collection of OpenEBS cStor Data Engine Operators
https://openebs.io
Apache License 2.0
94 stars 69 forks source link

Multiple podDisruptionBudgets created for pvc pods, preventing eviction #424

Closed dmallubhotla closed 2 years ago

dmallubhotla commented 2 years ago

I have a CSPC configured with 5 instances, and a storage class defined with a replicaCount of 3. Each new PVC creates a new cstor volume config, and it seems like each new cstor volume config is leading to a new pod disruption budget that covers 3 of the 5 pool instances.

As a result, there are multiple pod disruption budgets that get created covering the pods (say my nodes are A, B, C, D and E, then a pdb gets created covering A B C, and the next volume claim for example creates a CVC with a PDB covering A, C E. Then I can't evict A, because This pod has more than one PodDisruptionBudget, which the eviction subresource does not support..

I am not entirely sure whether this is an issue with my own setup, and this is just an unexpected behaviour, in which case I'm wondering whether it's possible to recreate the disruption budgets in a way that avoids this, or if it's an actual issue of some sort.

I'm not sure whether k8s support for multiple pdbs is the answer either. This has been discussed there: https://github.com/kubernetes/kubernetes/pull/90253.

dmallubhotla commented 2 years ago

Saw note in readme to open it at openebs/openebs, so I opened https://github.com/openebs/openebs/issues/3536 there