Issues in Attaching pvc for Ingester

[dakshrajgoyal]

Hello Team,

Getting below issues while upgrading and attaching pvc to statefulset component "ingester"

"Error: UPGRADE FAILED: cannot patch "loki-loki-distributed-ingester" with kind StatefulSet: StatefulSet.apps "loki-loki-distributed-ingester" is invalid: spec: Forbidden: updates to statefulset spec for fields other than 'replicas', 'ordinals', 'template', 'updateStrategy', 'persistentVolumeClaimRetentionPolicy' and 'minReadySeconds' are forbidden && cannot patch "loki-loki-distributed-querier" with kind StatefulSet: StatefulSet.apps "loki-loki-distributed-querier" is invalid: spec: Forbidden: updates to statefulset spec for fields other than 'replicas', 'ordinals', 'template', 'updateStrategy', 'persistentVolumeClaimRetentionPolicy' and 'minReadySeconds' are forbidden"

I have this in my yaml inside loki-values.yaml

ingester: kind: StatefulSet replicas: 1 ordinals: {{ $ingesterCount }} deploymentStrategy: type: RollingUpdate image: registry: null repository: null tag: null priorityClassName: null terminationGracePeriodSeconds: 300 topologySpreadConstraints: |

• maxSkew: 1 topologyKey: kubernetes.io/hostname whenUnsatisfiable: ScheduleAnyway labelSelector: matchLabels: {{- include "loki.ingesterSelectorLabels" . | nindent 6 }} affinity: | podAntiAffinity: requiredDuringSchedulingIgnoredDuringExecution:
  • labelSelector: matchLabels: {{- include "loki.ingesterSelectorLabels" . | nindent 10 }} topologyKey: kubernetes.io/hostname preferredDuringSchedulingIgnoredDuringExecution:
  • weight: 100 podAffinityTerm: labelSelector: matchLabels: {{- include "loki.ingesterSelectorLabels" . | nindent 12 }} topologyKey: failure-domain.beta.kubernetes.io/zone nodeSelector: {} tolerations: [] persistence: enabled: true inMemory: false claims:
    • name: data size: 40Gi storageClass: gp3 enableStatefulSetAutoDeletePVC: false persistentVolumeClaimRetentionPolicy: retain: "Delete" minReadySeconds: 5 whenDeleted: Retain whenScaled: Retain

[dakshrajgoyal]

Hello,

Can someone please help on the above issue ?

[HujinoKun]

Hi,

Delete your ingester's sts by making a backup first and restart your helm deployment

[leehosu]

Maybe try this?

https://serverfault.com/a/997236/319811