fusor / catasb

Ansible scripts to setup an 'oc cluster up' environment for testing the Service Catalog and Ansible Service Broker on EC2 or Local
47 stars 33 forks source link

local/linux/run_setup_local.sh ends in error waiting for ASB deployment configs #193

Open rwsu opened 6 years ago

rwsu commented 6 years ago

My deployment was on a centos7 vm.

snip ==> default: ok: [localhost] => { ==> default: "msg": [ ==> default: "oc v3.9.0-alpha.0+a0adcf4", ==> default: "kubernetes v1.8.1+0d5291c", ==> default: "features: Basic-Auth GSSAPI Kerberos SPNEGO" ==> default: ] ==> default: } snip ==> default: FAILED - RETRYING: Waiting 10 minutes for ASB deployment configs (3 retries left).

==> default: FAILED - RETRYING: Waiting 10 minutes for ASB deployment configs (2 retries left).

==> default: FAILED - RETRYING: Waiting 10 minutes for ASB deployment configs (1 retries left).

==> default: failed: [localhost] (item=asb) => {"attempts": 60, "changed": true, "cmd": "\"/root/bin/oc\" get deploymentconfig \"asb\" -o go-template='{{if eq .spec.replicas .status.availableReplicas}}good{{end}}' | grep 'good'", "delta": "0:00:00.162655", "end": "2017-12-05 01:43:03.310830", "failed": true, "item": "asb", "msg": "non-zero return code", "rc": 1, "start": "2017-12-05 01:43:03.148175", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ==> default: changed: [localhost] => (item=asb-etcd) ==> default: to retry, use: --limit @/home/vagrant/catasb/ansible/setup_local_environment.retry ==> default: ==> default: PLAY RECAP ***** ==> default: localhost : ok=70 changed=36 unreachable=0 failed=1

rthallisey commented 6 years ago

Can you get the status and logs from the broker pod? kubectl logs <broker_pod> kubectl describe pod <broker_pod

rwsu commented 6 years ago

Is asb-1-deploy the broker pod? I've included the sosreport here. sosreport.zip

[root@localhost bin]# ./oc get pods NAME READY STATUS RESTARTS AGE asb-1-deploy 0/1 Error 0 25m asb-etcd-1-6l7wm 1/1 Running 0 25m

[root@localhost bin]# ./kubectl logs asb-1-deploy --> Scaling asb-1 to 1 error: update acceptor rejected asb-1: pods for rc 'ansible-service-broker/asb-1' took longer than 600 seconds to become available

[root@localhost bin]# ./kubectl describe pod asb-1-deploy Name: asb-1-deploy Namespace: ansible-service-broker Node: localhost/192.168.121.129 Start Time: Tue, 05 Dec 2017 19:04:03 +0000 Labels: openshift.io/deployer-pod-for.name=asb-1 Annotations: openshift.io/deployment-config.name=asb openshift.io/deployment.name=asb-1 openshift.io/scc=restricted Status: Failed IP: 172.17.0.3 Controllers: Containers: deployment: Container ID: docker://df8441f53e9b51743a55a0b2df72813038526f1369a3c26178ecbcc9504d1869 Image: docker.io/openshift/origin-deployer:latest Image ID: docker-pullable://docker.io/openshift/origin-deployer@sha256:b5bc32a5035944f6ff0f12d6140c0b07305be1e5f0430b103e6387ebd432175d Port:
State: Terminated Reason: Error Exit Code: 1 Started: Tue, 05 Dec 2017 19:04:05 +0000 Finished: Tue, 05 Dec 2017 19:14:06 +0000 Ready: False Restart Count: 0 Environment: KUBERNETES_MASTER: https://127.0.0.1:8443 OPENSHIFT_MASTER: https://127.0.0.1:8443 BEARER_TOKEN_FILE: /var/run/secrets/kubernetes.io/serviceaccount/token OPENSHIFT_CA_DATA: -----BEGIN CERTIFICATE----- MIIC6jCCAdKgAwIBAgIBATANBgkqhkiG9w0BAQsFADAmMSQwIgYDVQQDDBtvcGVu c2hpZnQtc2lnbmVyQDE1MTI1MDA1NDYwHhcNMTcxMjA1MTkwMjI2WhcNMjIxMjA0 MTkwMjI3WjAmMSQwIgYDVQQDDBtvcGVuc2hpZnQtc2lnbmVyQDE1MTI1MDA1NDYw ggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQDTov17NoQ++YYfrtfaoMWm Hu2Kh3cRVQI3LfbT4hxdSuffn6UZ/2gYck7G9Sw5RE8HU/EiPAvbeBcCVNyTsU/v Iv7e7PE83S0+UuUnAMwmjSnHUllhDR9sD3UNgwtGAlEodJx4MB3s783DH8nogOcm snZ/xCWUckOXNsbUqroPKN0pjEJissnbSE+ctQAQBChsX7A41ct1gaT8Nk821q12 DmjK/hRMb3/9Rp6MGkX8G7VY09cpVc8NDevNYlVIbvNa3pZma79xxfpQ+j2chytB aUcTSUs6loi02jVWx7ubmrzZJ/H9k0hOLddbd3t2pQLFFt+d4SeLlCaDHT658a3t AgMBAAGjIzAhMA4GA1UdDwEB/wQEAwICpDAPBgNVHRMBAf8EBTADAQH/MA0GCSqG SIb3DQEBCwUAA4IBAQAqCqsZbmWnHlo+jUEMM0GvEU+dG/r4KeSys+utZ+2EMOpE 6li8co6cwP5OvaMdjdr2x+/dfACHNwx9AqIzb1q67WDHQ2t4oWPUnrLZ5YxIVzJK gXneukPZlkqfDhzU/r6H1ZF9pPxqV6SNuachzpi/E8rcH0CT/zOA65mhLFiaBvIr aQU8dUMwh8CFYt8Xce3+juj8IYxS5t+aFC2BbkhTWH8w7ziBTBJzDg5jjtOV9HTt 8MsA1Zk/ae6vjHpVmFZsfiydP5aFt6XEsmIkffxuOrwoHPiYv14cRyuVVKhI1/FF T/7tCF9vSue5JnKuwEdgPtNxEKCPne1rakGvRBzc -----END CERTIFICATE-----

  OPENSHIFT_DEPLOYMENT_NAME:    asb-1
  OPENSHIFT_DEPLOYMENT_NAMESPACE:   ansible-service-broker
Mounts:
  /var/run/secrets/kubernetes.io/serviceaccount from deployer-token-pnrf8 (ro)

Conditions: Type Status Initialized True Ready False PodScheduled True Volumes: deployer-token-pnrf8: Type: Secret (a volume populated by a Secret) SecretName: deployer-token-pnrf8 Optional: false QoS Class: BestEffort Node-Selectors: Tolerations: Events: FirstSeen LastSeen Count From SubObjectPath Type Reason Message


26m 26m 1 default-scheduler Normal Scheduled Successfully assigned asb-1-deploy to localhost 26m 26m 1 kubelet, localhost Normal SuccessfulMountVolume MountVolume.SetUp succeeded for volume "deployer-token-pnrf8" 26m 26m 1 kubelet, localhost spec.containers{deployment} Normal Pulled Container image "docker.io/openshift/origin-deployer:latest" already present on machine 26m 26m 1 kubelet, localhost spec.containers{deployment} Normal Created Created container 26m 26m 1 kubelet, localhost spec.containers{deployment} Normal Started Started container