deis / workflow

The open source PaaS for Kubernetes.
https://deis.com/workflow/
MIT License
1.3k stars 181 forks source link

Dockerfile Deployment crashes Deis Builder #790

Open davidchua opened 7 years ago

davidchua commented 7 years ago

After deploying a Dockerfile onto Deis Workflow, Application gets stuck in Launching App ... and attempting to redeploy brings down builder.

I am unable to pull out further logs to find out what went wrong inside of builder.

Below are my logs:

$ kubectl version
Server Version: version.Info{Major:"1", Minor:"5", GitVersion:"v1.5.4", GitCommit:"7243c69eb523aa4377bce883e7c0dd76b84709a1", GitTreeState:"clean", BuildDate:"2017-03-07T23:34:32Z", GoVersion:"go1.7.4", Compiler:"gc", Platform:"linux/amd64"}

Deis Workflow installed with: v2.9.0 on GKE

Events:
  FirstSeen     LastSeen        Count   From                                            SubobjectPath                   Type            Reason               Message
  ---------     --------        -----   ----                                            -------------                   --------        ------               -------
  2m            2m              1       {default-scheduler }                                                            Normal          Scheduled    Successfully assigned deis-builder-1805754844-qk5z7 to gke-kubernetes-pool-1-b3e2ffed-p0wg
  2m            2m              1       {kubelet gke-kubernetes-pool-1-b3e2ffed-p0wg}   spec.containers{deis-builder}   Normal          Created              Created container with docker id 41a3bf2cb2a1; Security:[seccomp=unconfined]
  2m            2m              1       {kubelet gke-kubernetes-pool-1-b3e2ffed-p0wg}   spec.containers{deis-builder}   Normal          Started              Started container with docker id 41a3bf2cb2a1
  1m            1m              1       {kubelet gke-kubernetes-pool-1-b3e2ffed-p0wg}   spec.containers{deis-builder}   Normal          Killing              Killing container with docker id 41a3bf2cb2a1: pod "deis-builder-1805754844-qk5z7_deis(85eb255b-1bf9-11e7-a4f7-42010a920022)" container "deis-builder" is unhealthy, it will be killed and re-created.
  1m            1m              1       {kubelet gke-kubernetes-pool-1-b3e2ffed-p0wg}   spec.containers{deis-builder}   Normal          Created              Created container with docker id 60a6cabe6e4c; Security:[seccomp=unconfined]
  1m            1m              1       {kubelet gke-kubernetes-pool-1-b3e2ffed-p0wg}   spec.containers{deis-builder}   Normal          Started              Started container with docker id 60a6cabe6e4c
  54s           54s             1       {kubelet gke-kubernetes-pool-1-b3e2ffed-p0wg}   spec.containers{deis-builder}   Normal          Started              Started container with docker id 37f98b501301
  54s           54s             1       {kubelet gke-kubernetes-pool-1-b3e2ffed-p0wg}   spec.containers{deis-builder}   Normal          Killing              Killing container with docker id 60a6cabe6e4c: pod "deis-builder-1805754844-qk5z7_deis(85eb255b-1bf9-11e7-a4f7-42010a920022)" container "deis-builder" is unhealthy, it will be killed and re-created.
  54s           54s             1       {kubelet gke-kubernetes-pool-1-b3e2ffed-p0wg}   spec.containers{deis-builder}   Normal          Created              Created container with docker id 37f98b501301; Security:[seccomp=unconfined]
  1m            15s             4       {kubelet gke-kubernetes-pool-1-b3e2ffed-p0wg}   spec.containers{deis-builder}   Warning         Unhealthy    Readiness probe failed: Get http://10.4.0.143:8092/readiness: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
  1m            15s             5       {kubelet gke-kubernetes-pool-1-b3e2ffed-p0wg}   spec.containers{deis-builder}   Warning         Unhealthy    Liveness probe failed: Get http://10.4.0.143:8092/healthz: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
  2m            12s             4       {kubelet gke-kubernetes-pool-1-b3e2ffed-p0wg}   spec.containers{deis-builder}   Normal          Pulled               Container image "quay.io/deis/builder:v2.6.1" already present on machine
  12s           12s             1       {kubelet gke-kubernetes-pool-1-b3e2ffed-p0wg}   spec.containers{deis-builder}   Normal          Killing              Killing container with docker id 37f98b501301: pod "deis-builder-1805754844-qk5z7_deis(85eb255b-1bf9-11e7-a4f7-42010a920022)" container "deis-builder" is unhealthy, it will be killed and re-created.
  12s           12s             1       {kubelet gke-kubernetes-pool-1-b3e2ffed-p0wg}   spec.containers{deis-builder}   Normal          Created              Created container with docker id 93597879ef60; Security:[seccomp=unconfined]
  12s           12s             1       {kubelet gke-kubernetes-pool-1-b3e2ffed-p0wg}   spec.containers{deis-builder}   Normal          Started              Started container with docker id 93597879ef60
 $ kubectl logs deis-builder-1805754844-qk5z7 -n deis -f    
2017/04/08 01:24:11 Starting health check server on port 8092
2017/04/08 01:24:11 Starting deleted app cleaner
2017/04/08 01:24:11 Starting SSH server on 0.0.0.0:2223
Listening on 0.0.0.0:2223
Accepting new connections.
Cryptophobia commented 6 years ago

This issue was moved to teamhephy/workflow#24