StackStorm / stackstorm-k8s

K8s Helm Chart that codifies StackStorm (aka "IFTTT for Ops" https://stackstorm.com/) Highly Availability fleet as a simple to use reproducible infrastructure-as-code app
https://helm.stackstorm.com/
Apache License 2.0
99 stars 107 forks source link

rabbitmq 'failed to merge schema: bad cookie' #378

Open guzzijones opened 10 months ago

guzzijones commented 10 months ago

I was getting this error in rabbitmq pods greater than 0.

Failed to merge schema: Bad cookie in table definition rabbit_user_permission rabbitmq

I ended up finding this solution

Step1: Downscale the statefulset it will not delete the PVC.

kubectl scale statefulsets stackstorm-ha-rabbitmq --replicas=1

Step2: Access the RabbitMQ Pod.

kubectl exec -it stackstorm-ha-rabbitmq-0 -- /bin/bash

Step3: Reset the cluster

rabbitmqctl stop_app
rabbitmqctl force_boot

Step4: Rescale the statefulset

  kubectl scale statefulsets stackstorm-ha-rabbitmq --namespace teps-rabbitmq --replicas=3
cognifloyd commented 4 months ago

Is there something we can change in this chart to help prevent/resolve this issue? Should this just be added to documentation somewhere? Or something changed in the values passed to the rabbitmq subchart?