search

armory / spinnaker-operator

Open Source Spinnaker Kubernetes Operator source code
Apache License 2.0
187 stars 70 forks source link

no endpoints available for service "spinnaker-operator" #276

Closed initisan closed 1 year ago

initisan commented 1 year ago

Hi team,

I’m trying to deploy armory/spinnaker-operator:1.3.0-rc.21 in kubernetes 1.23.8 with helm chart https://artifacthub.io/packages/helm/armory/armory-spinnaker-operator but it returns error below, but actually service spinnaker-operator is exist

no endpoints available for service "spinnaker-operator"

Deploy Environment

operator version: armory/spinnaker-operator:1.3.0-rc.21 kubernetes cluster version: 1.23.8 helm chart: https://artifacthub.io/packages/helm/armory/armory-spinnaker-operator

Detail helm3 error log

root@ansible:/opt/automation/atlas.release.deploy# helm upgrade spinnaker-operator --install --namespace spinnaker --timeout 2400s --atomic -f /opt/automation/atlas.release.deploy/override.yaml /opt/automation/atlas.release.deploy/atlas-release-chart-spinnaker-operator/helm --debug
WARNING: Kubernetes configuration file is group-readable. This is insecure. Location: /root/.kube/config
WARNING: Kubernetes configuration file is world-readable. This is insecure. Location: /root/.kube/config
history.go:56: [debug] getting history for release spinnaker-operator
upgrade.go:123: [debug] preparing upgrade for spinnaker-operator
upgrade.go:131: [debug] performing update for spinnaker-operator
upgrade.go:303: [debug] creating upgraded release for spinnaker-operator
client.go:209: [debug] checking 14 resources for changes
client.go:492: [debug] Looks like there are no changes for Secret "atlas-release-chart-spinnaker-operator-slack-config-api-url"
client.go:492: [debug] Looks like there are no changes for ConfigMap "spinnaker-operator-dashboard-configmap"
client.go:492: [debug] Looks like there are no changes for ClusterRole "atlas-release-chart-spinnaker-operator-deployer"
client.go:492: [debug] Looks like there are no changes for ClusterRole "atlas-release-chart-spinnaker-operator"
client.go:492: [debug] Looks like there are no changes for ClusterRoleBinding "atlas-release-chart-spinnaker-operator-deployer"
client.go:492: [debug] Looks like there are no changes for ClusterRoleBinding "atlas-release-chart-spinnaker-operator"
client.go:492: [debug] Looks like there are no changes for Deployment "atlas-release-chart-spinnaker-operator"
client.go:241: [debug] error updating the resource "spinnaker":
         cannot patch "spinnaker" with kind SpinnakerService: Internal error occurred: failed calling webhook "webhook-spinnakerservices-v1alpha2.spinnaker.io": failed to call webhook: Post "https://spinnaker-operator.spinnaker.svc:443/validate-spinnaker-io-v1alpha2-spinnakerservice?timeout=10s": no endpoints available for service "spinnaker-operator"
upgrade.go:369: [debug] warning: Upgrade "spinnaker-operator" failed: cannot patch "spinnaker" with kind SpinnakerService: Internal error occurred: failed calling webhook "webhook-spinnakerservices-v1alpha2.spinnaker.io": failed to call webhook: Post "https://spinnaker-operator.spinnaker.svc:443/validate-spinnaker-io-v1alpha2-spinnakerservice?timeout=10s": no endpoints available for service "spinnaker-operator"
upgrade.go:387: [debug] Upgrade failed and atomic is set, rolling back to last successful release
history.go:56: [debug] getting history for release spinnaker-operator
rollback.go:65: [debug] preparing rollback of spinnaker-operator
rollback.go:113: [debug] rolling back spinnaker-operator (current: v6, target: v5)
rollback.go:72: [debug] creating rolled back release for spinnaker-operator
rollback.go:78: [debug] performing rollback of spinnaker-operator
client.go:209: [debug] checking 14 resources for changes
client.go:492: [debug] Looks like there are no changes for Secret "atlas-release-chart-spinnaker-operator-slack-config-api-url"
client.go:492: [debug] Looks like there are no changes for ConfigMap "spinnaker-operator-dashboard-configmap"
client.go:492: [debug] Looks like there are no changes for ClusterRole "atlas-release-chart-spinnaker-operator-deployer"
client.go:492: [debug] Looks like there are no changes for ClusterRole "atlas-release-chart-spinnaker-operator"
client.go:492: [debug] Looks like there are no changes for ClusterRoleBinding "atlas-release-chart-spinnaker-operator-deployer"
client.go:492: [debug] Looks like there are no changes for ClusterRoleBinding "atlas-release-chart-spinnaker-operator"
client.go:492: [debug] Looks like there are no changes for Deployment "atlas-release-chart-spinnaker-operator"
client.go:492: [debug] Looks like there are no changes for AlertmanagerConfig "atlas-release-chart-spinnaker-operator-alert-manager-config"
client.go:492: [debug] Looks like there are no changes for PrometheusRule "atlas-release-chart-spinnaker-operator"
client.go:492: [debug] Looks like there are no changes for ServiceMonitor "spinnaker-services-metrics"
client.go:492: [debug] Looks like there are no changes for ServiceMonitor "spinnaker-gate-metrics"
client.go:492: [debug] Looks like there are no changes for SpinnakerService "spinnaker"
wait.go:47: [debug] beginning wait for 14 resources with timeout of 40m0s
rollback.go:233: [debug] superseding previous deployment 5
rollback.go:84: [debug] updating status for rolled back release for spinnaker-operator
Error: UPGRADE FAILED: release spinnaker-operator failed, and has been rolled back due to atomic being set: cannot patch "spinnaker" with kind SpinnakerService: Internal error occurred: failed calling webhook "webhook-spinnakerservices-v1alpha2.spinnaker.io": failed to call webhook: Post "https://spinnaker-operator.spinnaker.svc:443/validate-spinnaker-io-v1alpha2-spinnakerservice?timeout=10s": no endpoints available for service "spinnaker-operator"
helm.go:88: [debug] cannot patch "spinnaker" with kind SpinnakerService: Internal error occurred: failed calling webhook "webhook-spinnakerservices-v1alpha2.spinnaker.io": failed to call webhook: Post "https://spinnaker-operator.spinnaker.svc:443/validate-spinnaker-io-v1alpha2-spinnakerservice?timeout=10s": no endpoints available for service "spinnaker-operator"
helm.sh/helm/v3/pkg/kube.(*Client).Update
        helm.sh/helm/v3/pkg/kube/client.go:254
helm.sh/helm/v3/pkg/action.(*Upgrade).performUpgrade
        helm.sh/helm/v3/pkg/action/upgrade.go:317
helm.sh/helm/v3/pkg/action.(*Upgrade).Run
        helm.sh/helm/v3/pkg/action/upgrade.go:132
main.newUpgradeCmd.func2
        helm.sh/helm/v3/cmd/helm/upgrade.go:155
github.com/spf13/cobra.(*Command).execute
        github.com/spf13/cobra@v1.1.3/command.go:852
github.com/spf13/cobra.(*Command).ExecuteC
        github.com/spf13/cobra@v1.1.3/command.go:960
github.com/spf13/cobra.(*Command).Execute
        github.com/spf13/cobra@v1.1.3/command.go:897
main.main
        helm.sh/helm/v3/cmd/helm/helm.go:87
runtime.main
        runtime/proc.go:225
runtime.goexit
        runtime/asm_amd64.s:1371
release spinnaker-operator failed, and has been rolled back due to atomic being set
helm.sh/helm/v3/pkg/action.(*Upgrade).failRelease
        helm.sh/helm/v3/pkg/action/upgrade.go:420
helm.sh/helm/v3/pkg/action.(*Upgrade).performUpgrade
        helm.sh/helm/v3/pkg/action/upgrade.go:320
helm.sh/helm/v3/pkg/action.(*Upgrade).Run
        helm.sh/helm/v3/pkg/action/upgrade.go:132
main.newUpgradeCmd.func2
        helm.sh/helm/v3/cmd/helm/upgrade.go:155
github.com/spf13/cobra.(*Command).execute
        github.com/spf13/cobra@v1.1.3/command.go:852
github.com/spf13/cobra.(*Command).ExecuteC
        github.com/spf13/cobra@v1.1.3/command.go:960
github.com/spf13/cobra.(*Command).Execute
        github.com/spf13/cobra@v1.1.3/command.go:897
main.main
        helm.sh/helm/v3/cmd/helm/helm.go:87
runtime.main
        runtime/proc.go:225
runtime.goexit
        runtime/asm_amd64.s:1371
UPGRADE FAILED
main.newUpgradeCmd.func2
        helm.sh/helm/v3/cmd/helm/upgrade.go:157
github.com/spf13/cobra.(*Command).execute
        github.com/spf13/cobra@v1.1.3/command.go:852
github.com/spf13/cobra.(*Command).ExecuteC
        github.com/spf13/cobra@v1.1.3/command.go:960
github.com/spf13/cobra.(*Command).Execute
        github.com/spf13/cobra@v1.1.3/command.go:897
main.main
        helm.sh/helm/v3/cmd/helm/helm.go:87
runtime.main
        runtime/proc.go:225
runtime.goexit
        runtime/asm_amd64.s:1371

I tried both helm2 and helm3 but same issue thrown, could someone help here. thanks