search

kubernetes / kubernetes

Production-Grade Container Scheduling and Management
https://kubernetes.io
Apache License 2.0
110.27k stars 39.45k forks source link

Deployment deployment should support rollover #25905

Closed lavalamp closed 8 years ago

lavalamp commented 8 years ago

Same test as #22719 but different failure.

https://console.cloud.google.com/storage/kubernetes-jenkins/logs/kubernetes-e2e-gke/7324/

[It] deployment should support rollover
  /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/deployment.go:71
May 19 12:53:53.784: INFO: Pod name rollover-pod: Found 0 pods out of 4
May 19 12:53:58.790: INFO: Pod name rollover-pod: Found 4 pods out of 4
STEP: ensuring each pod is running
W0519 12:53:58.790804    4366 request.go:347] Field selector: v1 - pods - metadata.name - test-rollover-controller-1n0xm: need to check if this is versioned correctly.
W0519 12:53:58.792935    4366 request.go:347] Field selector: v1 - pods - metadata.name - test-rollover-controller-gg7bu: need to check if this is versioned correctly.
W0519 12:53:58.810121    4366 request.go:347] Field selector: v1 - pods - metadata.name - test-rollover-controller-psxi4: need to check if this is versioned correctly.
W0519 12:53:59.044348    4366 request.go:347] Field selector: v1 - pods - metadata.name - test-rollover-controller-sbus0: need to check if this is versioned correctly.
STEP: trying to dial each unique pod
May 19 12:53:59.123: INFO: Controller rollover-pod: Got non-empty result from replica 1 [test-rollover-controller-1n0xm]: "<!DOCTYPE html>\n<html>\n<head>\n<title>Welcome to nginx!</title>\n<style>\n    body {\n        width: 35em;\n        margin: 0 auto;\n        font-family: Tahoma, Verdana, Arial, sans-serif;\n    }\n</style>\n</head>\n<body>\n<h1>Welcome to nginx!</h1>\n<p>If you see this page, the nginx web server is successfully installed and\nworking. Further configuration is required.</p>\n\n<p>For online documentation and support please refer to\n<a href=\"http://nginx.org/\">nginx.org</a>.<br/>\nCommercial support is available at\n<a href=\"http://nginx.com/\">nginx.com</a>.</p>\n\n<p><em>Thank you for using nginx.</em></p>\n</body>\n</html>\n", 1 of 4 required successes so far
May 19 12:53:59.220: INFO: Controller rollover-pod: Got non-empty result from replica 2 [test-rollover-controller-gg7bu]: "<!DOCTYPE html>\n<html>\n<head>\n<title>Welcome to nginx!</title>\n<style>\n    body {\n        width: 35em;\n        margin: 0 auto;\n        font-family: Tahoma, Verdana, Arial, sans-serif;\n    }\n</style>\n</head>\n<body>\n<h1>Welcome to nginx!</h1>\n<p>If you see this page, the nginx web server is successfully installed and\nworking. Further configuration is required.</p>\n\n<p>For online documentation and support please refer to\n<a href=\"http://nginx.org/\">nginx.org</a>.<br/>\nCommercial support is available at\n<a href=\"http://nginx.com/\">nginx.com</a>.</p>\n\n<p><em>Thank you for using nginx.</em></p>\n</body>\n</html>\n", 2 of 4 required successes so far
May 19 12:53:59.299: INFO: Controller rollover-pod: Got non-empty result from replica 3 [test-rollover-controller-psxi4]: "<!DOCTYPE html>\n<html>\n<head>\n<title>Welcome to nginx!</title>\n<style>\n    body {\n        width: 35em;\n        margin: 0 auto;\n        font-family: Tahoma, Verdana, Arial, sans-serif;\n    }\n</style>\n</head>\n<body>\n<h1>Welcome to nginx!</h1>\n<p>If you see this page, the nginx web server is successfully installed and\nworking. Further configuration is required.</p>\n\n<p>For online documentation and support please refer to\n<a href=\"http://nginx.org/\">nginx.org</a>.<br/>\nCommercial support is available at\n<a href=\"http://nginx.com/\">nginx.com</a>.</p>\n\n<p><em>Thank you for using nginx.</em></p>\n</body>\n</html>\n", 3 of 4 required successes so far
May 19 12:53:59.358: INFO: Controller rollover-pod: Got non-empty result from replica 4 [test-rollover-controller-sbus0]: "<!DOCTYPE html>\n<html>\n<head>\n<title>Welcome to nginx!</title>\n<style>\n    body {\n        width: 35em;\n        margin: 0 auto;\n        font-family: Tahoma, Verdana, Arial, sans-serif;\n    }\n</style>\n</head>\n<body>\n<h1>Welcome to nginx!</h1>\n<p>If you see this page, the nginx web server is successfully installed and\nworking. Further configuration is required.</p>\n\n<p>For online documentation and support please refer to\n<a href=\"http://nginx.org/\">nginx.org</a>.<br/>\nCommercial support is available at\n<a href=\"http://nginx.com/\">nginx.com</a>.</p>\n\n<p><em>Thank you for using nginx.</em></p>\n</body>\n</html>\n", 4 of 4 required successes so far
May 19 12:54:05.368: INFO: Creating deployment test-rollover-deployment
May 19 12:54:07.440: INFO: Updating deployment test-rollover-deployment
May 19 12:59:11.501: INFO: Deployment: kind:"" apiVersion:"" . Selector = matchLabels:<key:"name" value:"rollover-pod" > 
May 19 12:59:11.501: INFO: All old ReplicaSets (1/2) of deployment test-rollover-deployment: kind:"" apiVersion:"" . Selector = matchLabels:<key:"name" value:"rollover-pod" > matchLabels:<key:"pod" value:"nginx" > matchLabels:<key:"pod-template-hash" value:"1321378927" > 
May 19 12:59:11.502: INFO: All old ReplicaSets (2/2) of deployment test-rollover-deployment: kind:"" apiVersion:"" . Selector = matchLabels:<key:"name" value:"rollover-pod" > matchLabels:<key:"pod-template-hash" value:"3098649686" > 
May 19 12:59:11.502: INFO: New ReplicaSet of deployment test-rollover-deployment: kind:"" apiVersion:"" . Selector = matchLabels:<key:"name" value:"rollover-pod" > matchLabels:<key:"pod-template-hash" value:"3104088211" > 
May 19 12:59:11.509: INFO: Pod test-rollover-controller-1n0xm is available: {TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:test-rollover-controller-1n0xm GenerateName:test-rollover-controller- Namespace:e2e-tests-deployment-oybdc SelfLink:/api/v1/namespaces/e2e-tests-deployment-oybdc/pods/test-rollover-controller-1n0xm UID:6a549fe5-1dfb-11e6-a239-42010af0001e ResourceVersion:2148 Generation:0 CreationTimestamp:{Time:2016-05-19 12:53:53 -0700 PDT} DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[name:rollover-pod pod:nginx pod-template-hash:1321378927] Annotations:map[kubernetes.io/created-by:{"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"e2e-tests-deployment-oybdc","name":"test-rollover-controller","uid":"6a49adea-1dfb-11e6-a239-42010af0001e","apiVersion":"extensions","resourceVersion":"1451"}}
] OwnerReferences:[] Finalizers:[]} Spec:{Volumes:[{Name:default-token-h8oc4 VolumeSource:{HostPath:<nil> EmptyDir:<nil> GCEPersistentDisk:<nil> AWSElasticBlockStore:<nil> GitRepo:<nil> Secret:0xc820bec7e0 NFS:<nil> ISCSI:<nil> Glusterfs:<nil> PersistentVolumeClaim:<nil> RBD:<nil> FlexVolume:<nil> Cinder:<nil> CephFS:<nil> Flocker:<nil> DownwardAPI:<nil> FC:<nil> AzureFile:<nil> ConfigMap:<nil>}}] InitContainers:[] Containers:[{Name:nginx Image:gcr.io/google_containers/nginx:1.7.9 Command:[] Args:[] WorkingDir: Ports:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:default-token-h8oc4 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:<nil> ReadinessProbe:<nil> Lifecycle:<nil> TerminationMessagePath:/dev/termination-log ImagePullPolicy:IfNotPresent SecurityContext:<nil> Stdin:false StdinOnce:false TTY:false}] RestartPolicy:Always TerminationGracePeriodSeconds:0xc820bec7f0 ActiveDeadlineSeconds:<nil> DNSPolicy:ClusterFirst NodeSelector:map[] ServiceAccountName:default NodeName:gke-jenkins-e2e-default-pool-b9f48651-3w70 SecurityContext:0xc820010bc0 ImagePullSecrets:[] Hostname: Subdomain:} Status:{Phase:Running Conditions:[{Type:Initialized Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:53 -0700 PDT} Reason: Message:} {Type:Ready Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:56 -0700 PDT} Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:53 -0700 PDT} Reason: Message:}] Message: Reason: HostIP:10.240.0.5 PodIP:10.180.2.14 StartTime:2016-05-19T12:53:53-07:00 InitContainerStatuses:[] ContainerStatuses:[{Name:nginx State:{Waiting:<nil> Running:0xc820bebb80 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:<nil>} Ready:true RestartCount:0 Image:gcr.io/google_containers/nginx:1.7.9 ImageID:docker://7332861f06d0f1487265e8c3d99bb8800df8e6770e11ad1fe5a7c580362c2a80 ContainerID:docker://fda2a1e9ab67db66a4173a76f5cbc266981ecff08f096f188eff8cbfa04fae77}]}}
May 19 12:59:11.510: INFO: Pod test-rollover-controller-gg7bu is available: {TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:test-rollover-controller-gg7bu GenerateName:test-rollover-controller- Namespace:e2e-tests-deployment-oybdc SelfLink:/api/v1/namespaces/e2e-tests-deployment-oybdc/pods/test-rollover-controller-gg7bu UID:6a505141-1dfb-11e6-a239-42010af0001e ResourceVersion:2151 Generation:0 CreationTimestamp:{Time:2016-05-19 12:53:53 -0700 PDT} DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[name:rollover-pod pod:nginx pod-template-hash:1321378927] Annotations:map[kubernetes.io/created-by:{"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"e2e-tests-deployment-oybdc","name":"test-rollover-controller","uid":"6a49adea-1dfb-11e6-a239-42010af0001e","apiVersion":"extensions","resourceVersion":"1451"}}
] OwnerReferences:[] Finalizers:[]} Spec:{Volumes:[{Name:default-token-h8oc4 VolumeSource:{HostPath:<nil> EmptyDir:<nil> GCEPersistentDisk:<nil> AWSElasticBlockStore:<nil> GitRepo:<nil> Secret:0xc820bec800 NFS:<nil> ISCSI:<nil> Glusterfs:<nil> PersistentVolumeClaim:<nil> RBD:<nil> FlexVolume:<nil> Cinder:<nil> CephFS:<nil> Flocker:<nil> DownwardAPI:<nil> FC:<nil> AzureFile:<nil> ConfigMap:<nil>}}] InitContainers:[] Containers:[{Name:nginx Image:gcr.io/google_containers/nginx:1.7.9 Command:[] Args:[] WorkingDir: Ports:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:default-token-h8oc4 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:<nil> ReadinessProbe:<nil> Lifecycle:<nil> TerminationMessagePath:/dev/termination-log ImagePullPolicy:IfNotPresent SecurityContext:<nil> Stdin:false StdinOnce:false TTY:false}] RestartPolicy:Always TerminationGracePeriodSeconds:0xc820bec7f8 ActiveDeadlineSeconds:<nil> DNSPolicy:ClusterFirst NodeSelector:map[] ServiceAccountName:default NodeName:gke-jenkins-e2e-default-pool-b9f48651-wnyy SecurityContext:0xc820010dc0 ImagePullSecrets:[] Hostname: Subdomain:} Status:{Phase:Running Conditions:[{Type:Initialized Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:53 -0700 PDT} Reason: Message:} {Type:Ready Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:58 -0700 PDT} Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:53 -0700 PDT} Reason: Message:}] Message: Reason: HostIP:10.240.0.4 PodIP:10.180.0.16 StartTime:2016-05-19T12:53:53-07:00 InitContainerStatuses:[] ContainerStatuses:[{Name:nginx State:{Waiting:<nil> Running:0xc820bebbc0 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:<nil>} Ready:true RestartCount:0 Image:gcr.io/google_containers/nginx:1.7.9 ImageID:docker://7332861f06d0f1487265e8c3d99bb8800df8e6770e11ad1fe5a7c580362c2a80 ContainerID:docker://11a24322c7705325a5aa508936368e67faa926c98220e459c91cb8f0450f217a}]}}
May 19 12:59:11.510: INFO: Pod test-rollover-controller-sbus0 is available: {TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:test-rollover-controller-sbus0 GenerateName:test-rollover-controller- Namespace:e2e-tests-deployment-oybdc SelfLink:/api/v1/namespaces/e2e-tests-deployment-oybdc/pods/test-rollover-controller-sbus0 UID:6a54c8a3-1dfb-11e6-a239-42010af0001e ResourceVersion:2159 Generation:0 CreationTimestamp:{Time:2016-05-19 12:53:53 -0700 PDT} DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[pod:nginx pod-template-hash:1321378927 name:rollover-pod] Annotations:map[kubernetes.io/created-by:{"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"e2e-tests-deployment-oybdc","name":"test-rollover-controller","uid":"6a49adea-1dfb-11e6-a239-42010af0001e","apiVersion":"extensions","resourceVersion":"1451"}}
] OwnerReferences:[] Finalizers:[]} Spec:{Volumes:[{Name:default-token-h8oc4 VolumeSource:{HostPath:<nil> EmptyDir:<nil> GCEPersistentDisk:<nil> AWSElasticBlockStore:<nil> GitRepo:<nil> Secret:0xc820bec810 NFS:<nil> ISCSI:<nil> Glusterfs:<nil> PersistentVolumeClaim:<nil> RBD:<nil> FlexVolume:<nil> Cinder:<nil> CephFS:<nil> Flocker:<nil> DownwardAPI:<nil> FC:<nil> AzureFile:<nil> ConfigMap:<nil>}}] InitContainers:[] Containers:[{Name:nginx Image:gcr.io/google_containers/nginx:1.7.9 Command:[] Args:[] WorkingDir: Ports:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:default-token-h8oc4 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:<nil> ReadinessProbe:<nil> Lifecycle:<nil> TerminationMessagePath:/dev/termination-log ImagePullPolicy:IfNotPresent SecurityContext:<nil> Stdin:false StdinOnce:false TTY:false}] RestartPolicy:Always TerminationGracePeriodSeconds:0xc820bec820 ActiveDeadlineSeconds:<nil> DNSPolicy:ClusterFirst NodeSelector:map[] ServiceAccountName:default NodeName:gke-jenkins-e2e-default-pool-b9f48651-07l9 SecurityContext:0xc8200110c0 ImagePullSecrets:[] Hostname: Subdomain:} Status:{Phase:Running Conditions:[{Type:Initialized Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:53 -0700 PDT} Reason: Message:} {Type:Ready Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:55 -0700 PDT} Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:54 -0700 PDT} Reason: Message:}] Message: Reason: HostIP:10.240.0.6 PodIP:10.180.1.14 StartTime:2016-05-19T12:53:53-07:00 InitContainerStatuses:[] ContainerStatuses:[{Name:nginx State:{Waiting:<nil> Running:0xc820bebc00 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:<nil>} Ready:true RestartCount:0 Image:gcr.io/google_containers/nginx:1.7.9 ImageID:docker://7332861f06d0f1487265e8c3d99bb8800df8e6770e11ad1fe5a7c580362c2a80 ContainerID:docker://0c45e77b044e4a6afe13f5b4642ca5137baea3adcea14004e95000c080f61057}]}}
May 19 12:59:11.510: INFO: Pod test-rollover-deployment-3104088211-a84by is available: {TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:test-rollover-deployment-3104088211-a84by GenerateName:test-rollover-deployment-3104088211- Namespace:e2e-tests-deployment-oybdc SelfLink:/api/v1/namespaces/e2e-tests-deployment-oybdc/pods/test-rollover-deployment-3104088211-a84by UID:81ca06e1-1dfb-11e6-a239-42010af0001e ResourceVersion:3211 Generation:0 CreationTimestamp:{Time:2016-05-19 12:54:33 -0700 PDT} DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[name:rollover-pod pod-template-hash:3104088211] Annotations:map[kubernetes.io/created-by:{"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"e2e-tests-deployment-oybdc","name":"test-rollover-deployment-3104088211","uid":"7273bd6e-1dfb-11e6-a239-42010af0001e","apiVersion":"extensions","resourceVersion":"3146"}}
] OwnerReferences:[] Finalizers:[]} Spec:{Volumes:[{Name:default-token-h8oc4 VolumeSource:{HostPath:<nil> EmptyDir:<nil> GCEPersistentDisk:<nil> AWSElasticBlockStore:<nil> GitRepo:<nil> Secret:0xc8209a5ea0 NFS:<nil> ISCSI:<nil> Glusterfs:<nil> PersistentVolumeClaim:<nil> RBD:<nil> FlexVolume:<nil> Cinder:<nil> CephFS:<nil> Flocker:<nil> DownwardAPI:<nil> FC:<nil> AzureFile:<nil> ConfigMap:<nil>}}] InitContainers:[] Containers:[{Name:redis Image:gcr.io/google_containers/redis:e2e Command:[] Args:[] WorkingDir: Ports:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:default-token-h8oc4 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:<nil> ReadinessProbe:<nil> Lifecycle:<nil> TerminationMessagePath:/dev/termination-log ImagePullPolicy:IfNotPresent SecurityContext:<nil> Stdin:false StdinOnce:false TTY:false}] RestartPolicy:Always TerminationGracePeriodSeconds:0xc8209a5eb0 ActiveDeadlineSeconds:<nil> DNSPolicy:ClusterFirst NodeSelector:map[] ServiceAccountName:default NodeName:gke-jenkins-e2e-default-pool-b9f48651-3w70 SecurityContext:0xc820a50900 ImagePullSecrets:[] Hostname: Subdomain:} Status:{Phase:Running Conditions:[{Type:Initialized Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:33 -0700 PDT} Reason: Message:} {Type:Ready Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:35 -0700 PDT} Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:33 -0700 PDT} Reason: Message:}] Message: Reason: HostIP:10.240.0.5 PodIP:10.180.2.3 StartTime:2016-05-19T12:54:33-07:00 InitContainerStatuses:[] ContainerStatuses:[{Name:redis State:{Waiting:<nil> Running:0xc820dd8980 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:<nil>} Ready:true RestartCount:0 Image:gcr.io/google_containers/redis:e2e ImageID:docker://e5f6c5a2b5646828f51e8e0d30a2987df7e8183ab2c3ed0ca19eaa03cc5db08c ContainerID:docker://8ccd03769c41cf2757c2eba728342d3ca0024db4c35627738f8ed141b445b47c}]}}
May 19 12:59:11.510: INFO: Pod test-rollover-deployment-3104088211-cc8bz is available: {TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:test-rollover-deployment-3104088211-cc8bz GenerateName:test-rollover-deployment-3104088211- Namespace:e2e-tests-deployment-oybdc SelfLink:/api/v1/namespaces/e2e-tests-deployment-oybdc/pods/test-rollover-deployment-3104088211-cc8bz UID:72a1aa22-1dfb-11e6-a239-42010af0001e ResourceVersion:2399 Generation:0 CreationTimestamp:{Time:2016-05-19 12:54:07 -0700 PDT} DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[name:rollover-pod pod-template-hash:3104088211] Annotations:map[kubernetes.io/created-by:{"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"e2e-tests-deployment-oybdc","name":"test-rollover-deployment-3104088211","uid":"7273bd6e-1dfb-11e6-a239-42010af0001e","apiVersion":"extensions","resourceVersion":"2284"}}
] OwnerReferences:[] Finalizers:[]} Spec:{Volumes:[{Name:default-token-h8oc4 VolumeSource:{HostPath:<nil> EmptyDir:<nil> GCEPersistentDisk:<nil> AWSElasticBlockStore:<nil> GitRepo:<nil> Secret:0xc8209a5ec0 NFS:<nil> ISCSI:<nil> Glusterfs:<nil> PersistentVolumeClaim:<nil> RBD:<nil> FlexVolume:<nil> Cinder:<nil> CephFS:<nil> Flocker:<nil> DownwardAPI:<nil> FC:<nil> AzureFile:<nil> ConfigMap:<nil>}}] InitContainers:[] Containers:[{Name:redis Image:gcr.io/google_containers/redis:e2e Command:[] Args:[] WorkingDir: Ports:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:default-token-h8oc4 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:<nil> ReadinessProbe:<nil> Lifecycle:<nil> TerminationMessagePath:/dev/termination-log ImagePullPolicy:IfNotPresent SecurityContext:<nil> Stdin:false StdinOnce:false TTY:false}] RestartPolicy:Always TerminationGracePeriodSeconds:0xc8209a5eb8 ActiveDeadlineSeconds:<nil> DNSPolicy:ClusterFirst NodeSelector:map[] ServiceAccountName:default NodeName:gke-jenkins-e2e-default-pool-b9f48651-wnyy SecurityContext:0xc820a50980 ImagePullSecrets:[] Hostname: Subdomain:} Status:{Phase:Running Conditions:[{Type:Initialized Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:07 -0700 PDT} Reason: Message:} {Type:Ready Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:08 -0700 PDT} Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:07 -0700 PDT} Reason: Message:}] Message: Reason: HostIP:10.240.0.4 PodIP:10.180.0.15 StartTime:2016-05-19T12:54:07-07:00 InitContainerStatuses:[] ContainerStatuses:[{Name:redis State:{Waiting:<nil> Running:0xc820dd89c0 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:<nil>} Ready:true RestartCount:0 Image:gcr.io/google_containers/redis:e2e ImageID:docker://e5f6c5a2b5646828f51e8e0d30a2987df7e8183ab2c3ed0ca19eaa03cc5db08c ContainerID:docker://8acf88086bb1745f5172731e1f8c1c527c923c3fc0162632f0369e9fc1ec2f0e}]}}
May 19 12:59:11.510: INFO: Pod test-rollover-deployment-3104088211-vme5t is available: {TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:test-rollover-deployment-3104088211-vme5t GenerateName:test-rollover-deployment-3104088211- Namespace:e2e-tests-deployment-oybdc SelfLink:/api/v1/namespaces/e2e-tests-deployment-oybdc/pods/test-rollover-deployment-3104088211-vme5t UID:72a285b7-1dfb-11e6-a239-42010af0001e ResourceVersion:3289 Generation:0 CreationTimestamp:{Time:2016-05-19 12:54:07 -0700 PDT} DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[pod-template-hash:3104088211 name:rollover-pod] Annotations:map[kubernetes.io/created-by:{"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"e2e-tests-deployment-oybdc","name":"test-rollover-deployment-3104088211","uid":"7273bd6e-1dfb-11e6-a239-42010af0001e","apiVersion":"extensions","resourceVersion":"2284"}}
] OwnerReferences:[] Finalizers:[]} Spec:{Volumes:[{Name:default-token-h8oc4 VolumeSource:{HostPath:<nil> EmptyDir:<nil> GCEPersistentDisk:<nil> AWSElasticBlockStore:<nil> GitRepo:<nil> Secret:0xc8209a5ed0 NFS:<nil> ISCSI:<nil> Glusterfs:<nil> PersistentVolumeClaim:<nil> RBD:<nil> FlexVolume:<nil> Cinder:<nil> CephFS:<nil> Flocker:<nil> DownwardAPI:<nil> FC:<nil> AzureFile:<nil> ConfigMap:<nil>}}] InitContainers:[] Containers:[{Name:redis Image:gcr.io/google_containers/redis:e2e Command:[] Args:[] WorkingDir: Ports:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:default-token-h8oc4 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:<nil> ReadinessProbe:<nil> Lifecycle:<nil> TerminationMessagePath:/dev/termination-log ImagePullPolicy:IfNotPresent SecurityContext:<nil> Stdin:false StdinOnce:false TTY:false}] RestartPolicy:Always TerminationGracePeriodSeconds:0xc8209a5ee0 ActiveDeadlineSeconds:<nil> DNSPolicy:ClusterFirst NodeSelector:map[] ServiceAccountName:default NodeName:gke-jenkins-e2e-default-pool-b9f48651-07l9 SecurityContext:0xc820a50a00 ImagePullSecrets:[] Hostname: Subdomain:} Status:{Phase:Running Conditions:[{Type:Initialized Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:07 -0700 PDT} Reason: Message:} {Type:Ready Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:39 -0700 PDT} Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:07 -0700 PDT} Reason: Message:}] Message: Reason: HostIP:10.240.0.6 PodIP:10.180.1.12 StartTime:2016-05-19T12:54:07-07:00 InitContainerStatuses:[] ContainerStatuses:[{Name:redis State:{Waiting:<nil> Running:0xc820dd8a00 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:<nil>} Ready:true RestartCount:0 Image:gcr.io/google_containers/redis:e2e ImageID:docker://e5f6c5a2b5646828f51e8e0d30a2987df7e8183ab2c3ed0ca19eaa03cc5db08c ContainerID:docker://f9eb83c777573747dde4a51a7f06ac41958aa03e44e879118922313f19d45c44}]}}
May 19 12:59:11.513: INFO: Deleting deployment test-rollover-deployment
[AfterEach] [k8s.io] Deployment
  /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:109
STEP: Collecting events from namespace "e2e-tests-deployment-oybdc".
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:53 -0700 PDT} - event for test-rollover-controller: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-controller-sbus0
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:53 -0700 PDT} - event for test-rollover-controller: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-controller-1n0xm
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:53 -0700 PDT} - event for test-rollover-controller: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-controller-psxi4
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:53 -0700 PDT} - event for test-rollover-controller: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-controller-gg7bu
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:53 -0700 PDT} - event for test-rollover-controller-gg7bu: {default-scheduler } Scheduled: Successfully assigned test-rollover-controller-gg7bu to gke-jenkins-e2e-default-pool-b9f48651-wnyy
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:54 -0700 PDT} - event for test-rollover-controller-1n0xm: {default-scheduler } Scheduled: Successfully assigned test-rollover-controller-1n0xm to gke-jenkins-e2e-default-pool-b9f48651-3w70
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:54 -0700 PDT} - event for test-rollover-controller-psxi4: {default-scheduler } Scheduled: Successfully assigned test-rollover-controller-psxi4 to gke-jenkins-e2e-default-pool-b9f48651-wnyy
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:54 -0700 PDT} - event for test-rollover-controller-sbus0: {default-scheduler } Scheduled: Successfully assigned test-rollover-controller-sbus0 to gke-jenkins-e2e-default-pool-b9f48651-07l9
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:54 -0700 PDT} - event for test-rollover-controller-sbus0: {kubelet gke-jenkins-e2e-default-pool-b9f48651-07l9} Created: Created container with docker id 0c45e77b044e
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:54 -0700 PDT} - event for test-rollover-controller-sbus0: {kubelet gke-jenkins-e2e-default-pool-b9f48651-07l9} Pulled: Container image "gcr.io/google_containers/nginx:1.7.9" already present on machine
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:55 -0700 PDT} - event for test-rollover-controller-1n0xm: {kubelet gke-jenkins-e2e-default-pool-b9f48651-3w70} Pulled: Container image "gcr.io/google_containers/nginx:1.7.9" already present on machine
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:55 -0700 PDT} - event for test-rollover-controller-1n0xm: {kubelet gke-jenkins-e2e-default-pool-b9f48651-3w70} Created: Created container with docker id fda2a1e9ab67
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:55 -0700 PDT} - event for test-rollover-controller-gg7bu: {kubelet gke-jenkins-e2e-default-pool-b9f48651-wnyy} Created: Created container with docker id 11a24322c770
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:55 -0700 PDT} - event for test-rollover-controller-gg7bu: {kubelet gke-jenkins-e2e-default-pool-b9f48651-wnyy} Pulled: Container image "gcr.io/google_containers/nginx:1.7.9" already present on machine
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:55 -0700 PDT} - event for test-rollover-controller-psxi4: {kubelet gke-jenkins-e2e-default-pool-b9f48651-wnyy} Started: Started container with docker id 01cf0674457e
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:55 -0700 PDT} - event for test-rollover-controller-psxi4: {kubelet gke-jenkins-e2e-default-pool-b9f48651-wnyy} Pulled: Container image "gcr.io/google_containers/nginx:1.7.9" already present on machine
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:55 -0700 PDT} - event for test-rollover-controller-psxi4: {kubelet gke-jenkins-e2e-default-pool-b9f48651-wnyy} Created: Created container with docker id 01cf0674457e
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:55 -0700 PDT} - event for test-rollover-controller-sbus0: {kubelet gke-jenkins-e2e-default-pool-b9f48651-07l9} Started: Started container with docker id 0c45e77b044e
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:56 -0700 PDT} - event for test-rollover-controller-1n0xm: {kubelet gke-jenkins-e2e-default-pool-b9f48651-3w70} Started: Started container with docker id fda2a1e9ab67
May 19 13:00:11.603: INFO: At {2016-05-19 12:53:56 -0700 PDT} - event for test-rollover-controller-gg7bu: {kubelet gke-jenkins-e2e-default-pool-b9f48651-wnyy} Started: Started container with docker id 11a24322c770
May 19 13:00:11.603: INFO: At {2016-05-19 12:54:06 -0700 PDT} - event for test-rollover-controller: {replicaset-controller } SuccessfulDelete: Deleted pod: test-rollover-controller-psxi4
May 19 13:00:11.603: INFO: At {2016-05-19 12:54:06 -0700 PDT} - event for test-rollover-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-rollover-deployment-3098649686 to 2
May 19 13:00:11.603: INFO: At {2016-05-19 12:54:06 -0700 PDT} - event for test-rollover-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-rollover-deployment-3098649686 to 1
May 19 13:00:11.603: INFO: At {2016-05-19 12:54:06 -0700 PDT} - event for test-rollover-deployment: {deployment-controller } ScalingReplicaSet: Scaled down replica set test-rollover-controller to 3
May 19 13:00:11.603: INFO: At {2016-05-19 12:54:06 -0700 PDT} - event for test-rollover-deployment-3098649686: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-deployment-3098649686-izas7
May 19 13:00:11.603: INFO: At {2016-05-19 12:54:06 -0700 PDT} - event for test-rollover-deployment-3098649686-izas7: {default-scheduler } Scheduled: Successfully assigned test-rollover-deployment-3098649686-izas7 to gke-jenkins-e2e-default-pool-b9f48651-3w70
May 19 13:00:11.603: INFO: At {2016-05-19 12:54:07 -0700 PDT} - event for test-rollover-controller-psxi4: {kubelet gke-jenkins-e2e-default-pool-b9f48651-wnyy} Killing: Killing container with docker id 01cf0674457e: Need to kill pod.
May 19 13:00:11.603: INFO: At {2016-05-19 12:54:07 -0700 PDT} - event for test-rollover-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-rollover-deployment-3104088211 to 2
May 19 13:00:11.603: INFO: At {2016-05-19 12:54:07 -0700 PDT} - event for test-rollover-deployment: {deployment-controller } ScalingReplicaSet: Scaled down replica set test-rollover-deployment-3098649686 to 0
May 19 13:00:11.603: INFO: At {2016-05-19 12:54:07 -0700 PDT} - event for test-rollover-deployment-3098649686: {replicaset-controller } SuccessfulDelete: Deleted pod: test-rollover-deployment-3098649686-izas7
May 19 13:00:11.603: INFO: At {2016-05-19 12:54:07 -0700 PDT} - event for test-rollover-deployment-3098649686: {replicaset-controller } SuccessfulDelete: Deleted pod: test-rollover-deployment-3098649686-nn9hp
May 19 13:00:11.603: INFO: At {2016-05-19 12:54:07 -0700 PDT} - event for test-rollover-deployment-3098649686: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-deployment-3098649686-nn9hp
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:07 -0700 PDT} - event for test-rollover-deployment-3098649686-nn9hp: {default-scheduler } Scheduled: Successfully assigned test-rollover-deployment-3098649686-nn9hp to gke-jenkins-e2e-default-pool-b9f48651-wnyy
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:07 -0700 PDT} - event for test-rollover-deployment-3104088211: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-deployment-3104088211-vme5t
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:07 -0700 PDT} - event for test-rollover-deployment-3104088211: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-deployment-3104088211-cc8bz
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:07 -0700 PDT} - event for test-rollover-deployment-3104088211-cc8bz: {default-scheduler } Scheduled: Successfully assigned test-rollover-deployment-3104088211-cc8bz to gke-jenkins-e2e-default-pool-b9f48651-wnyy
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:07 -0700 PDT} - event for test-rollover-deployment-3104088211-vme5t: {default-scheduler } Scheduled: Successfully assigned test-rollover-deployment-3104088211-vme5t to gke-jenkins-e2e-default-pool-b9f48651-07l9
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:08 -0700 PDT} - event for test-rollover-deployment-3104088211-cc8bz: {kubelet gke-jenkins-e2e-default-pool-b9f48651-wnyy} Created: Created container with docker id 8acf88086bb1
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:08 -0700 PDT} - event for test-rollover-deployment-3104088211-cc8bz: {kubelet gke-jenkins-e2e-default-pool-b9f48651-wnyy} Started: Started container with docker id 8acf88086bb1
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:08 -0700 PDT} - event for test-rollover-deployment-3104088211-cc8bz: {kubelet gke-jenkins-e2e-default-pool-b9f48651-wnyy} Pulled: Container image "gcr.io/google_containers/redis:e2e" already present on machine
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:08 -0700 PDT} - event for test-rollover-deployment-3104088211-vme5t: {kubelet gke-jenkins-e2e-default-pool-b9f48651-07l9} Pulling: pulling image "gcr.io/google_containers/redis:e2e"
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:14 -0700 PDT} - event for test-rollover-deployment-3098649686-izas7: {kubelet gke-jenkins-e2e-default-pool-b9f48651-3w70} Pulling: pulling image "gcr.io/google_samples/gb-redisslave:v1"
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:14 -0700 PDT} - event for test-rollover-deployment-3098649686-nn9hp: {kubelet gke-jenkins-e2e-default-pool-b9f48651-wnyy} Pulling: pulling image "gcr.io/google_samples/gb-redisslave:v1"
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:30 -0700 PDT} - event for test-rollover-deployment-3098649686-izas7: {kubelet gke-jenkins-e2e-default-pool-b9f48651-3w70} Pulled: Successfully pulled image "gcr.io/google_samples/gb-redisslave:v1"
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:30 -0700 PDT} - event for test-rollover-deployment-3098649686-izas7: {kubelet gke-jenkins-e2e-default-pool-b9f48651-3w70} FailedSync: Error syncing pod, skipping: failed to "StartContainer" for "redis-slave" with RunContainerError: "GenerateRunContainerOptions: impossible: cannot find the mounted volumes for pod \"test-rollover-deployment-3098649686-izas7_e2e-tests-deployment-oybdc(71ff315a-1dfb-11e6-a239-42010af0001e)\""

May 19 13:00:11.604: INFO: At {2016-05-19 12:54:33 -0700 PDT} - event for test-rollover-deployment: {deployment-controller } ScalingReplicaSet: Scaled down replica set test-rollover-controller to 2
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:33 -0700 PDT} - event for test-rollover-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-rollover-deployment-3104088211 to 3
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:33 -0700 PDT} - event for test-rollover-deployment-3098649686-nn9hp: {kubelet gke-jenkins-e2e-default-pool-b9f48651-wnyy} FailedSync: Error syncing pod, skipping: failed to "StartContainer" for "redis-slave" with RunContainerError: "GenerateRunContainerOptions: impossible: cannot find the mounted volumes for pod \"test-rollover-deployment-3098649686-nn9hp_e2e-tests-deployment-oybdc(72220963-1dfb-11e6-a239-42010af0001e)\""

May 19 13:00:11.604: INFO: At {2016-05-19 12:54:33 -0700 PDT} - event for test-rollover-deployment-3098649686-nn9hp: {kubelet gke-jenkins-e2e-default-pool-b9f48651-wnyy} Pulled: Successfully pulled image "gcr.io/google_samples/gb-redisslave:v1"
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:33 -0700 PDT} - event for test-rollover-deployment-3104088211: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-deployment-3104088211-a84by
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:33 -0700 PDT} - event for test-rollover-deployment-3104088211-a84by: {kubelet gke-jenkins-e2e-default-pool-b9f48651-3w70} Pulled: Container image "gcr.io/google_containers/redis:e2e" already present on machine
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:33 -0700 PDT} - event for test-rollover-deployment-3104088211-a84by: {default-scheduler } Scheduled: Successfully assigned test-rollover-deployment-3104088211-a84by to gke-jenkins-e2e-default-pool-b9f48651-3w70
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:34 -0700 PDT} - event for test-rollover-deployment-3104088211-a84by: {kubelet gke-jenkins-e2e-default-pool-b9f48651-3w70} Started: Started container with docker id 8ccd03769c41
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:34 -0700 PDT} - event for test-rollover-deployment-3104088211-a84by: {kubelet gke-jenkins-e2e-default-pool-b9f48651-3w70} Created: Created container with docker id 8ccd03769c41
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:38 -0700 PDT} - event for test-rollover-deployment-3104088211-vme5t: {kubelet gke-jenkins-e2e-default-pool-b9f48651-07l9} Started: Started container with docker id f9eb83c77757
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:38 -0700 PDT} - event for test-rollover-deployment-3104088211-vme5t: {kubelet gke-jenkins-e2e-default-pool-b9f48651-07l9} Created: Created container with docker id f9eb83c77757
May 19 13:00:11.604: INFO: At {2016-05-19 12:54:38 -0700 PDT} - event for test-rollover-deployment-3104088211-vme5t: {kubelet gke-jenkins-e2e-default-pool-b9f48651-07l9} Pulled: Successfully pulled image "gcr.io/google_containers/redis:e2e"
May 19 13:00:11.619: INFO: POD                                                               NODE                                        PHASE    GRACE  CONDITIONS
May 19 13:00:11.619: INFO: test-webserver-fef6df7b-1dfb-11e6-a46c-0242ac110003               gke-jenkins-e2e-default-pool-b9f48651-wnyy  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:58:03 -0700 PDT}  } {Ready False {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:58:03 -0700 PDT} ContainersNotReady containers with unready status: [test-webserber]} {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:58:03 -0700 PDT}  }]
May 19 13:00:11.619: INFO: test-rollover-controller-1n0xm                                    gke-jenkins-e2e-default-pool-b9f48651-3w70  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:53 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:56 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:53 -0700 PDT}  }]
May 19 13:00:11.619: INFO: test-rollover-controller-gg7bu                                    gke-jenkins-e2e-default-pool-b9f48651-wnyy  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:53 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:58 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:53 -0700 PDT}  }]
May 19 13:00:11.619: INFO: test-rollover-controller-sbus0                                    gke-jenkins-e2e-default-pool-b9f48651-07l9  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:53 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:55 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:54 -0700 PDT}  }]
May 19 13:00:11.619: INFO: test-rollover-deployment-3104088211-a84by                         gke-jenkins-e2e-default-pool-b9f48651-3w70  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:54:33 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:54:35 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:54:33 -0700 PDT}  }]
May 19 13:00:11.619: INFO: test-rollover-deployment-3104088211-cc8bz                         gke-jenkins-e2e-default-pool-b9f48651-wnyy  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:54:07 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:54:08 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:54:07 -0700 PDT}  }]
May 19 13:00:11.619: INFO: test-rollover-deployment-3104088211-vme5t                         gke-jenkins-e2e-default-pool-b9f48651-07l9  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:54:07 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:54:39 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:54:07 -0700 PDT}  }]
May 19 13:00:11.619: INFO: foo-36hvx                                                         gke-jenkins-e2e-default-pool-b9f48651-3w70  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:18 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:21 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:18 -0700 PDT}  }]
May 19 13:00:11.619: INFO: foo-bklsf                                                         gke-jenkins-e2e-default-pool-b9f48651-3w70  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:18 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:21 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:18 -0700 PDT}  }]
May 19 13:00:11.619: INFO: foo-07p3z                                                         gke-jenkins-e2e-default-pool-b9f48651-07l9  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:19 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:21 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:19 -0700 PDT}  }]
May 19 13:00:11.619: INFO: foo-b91ft                                                         gke-jenkins-e2e-default-pool-b9f48651-3w70  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:19 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:22 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:19 -0700 PDT}  }]
May 19 13:00:11.619: INFO: scale-down-ug6k3                                                  gke-jenkins-e2e-default-pool-b9f48651-3w70  Running  30s    [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:59:20 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:59:21 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:59:21 -0700 PDT}  }]
May 19 13:00:11.619: INFO: fluentd-cloud-logging-gke-jenkins-e2e-default-pool-b9f48651-07l9  gke-jenkins-e2e-default-pool-b9f48651-07l9  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:03 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:25 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:03 -0700 PDT}  }]
May 19 13:00:11.619: INFO: fluentd-cloud-logging-gke-jenkins-e2e-default-pool-b9f48651-3w70  gke-jenkins-e2e-default-pool-b9f48651-3w70  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:03 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:25 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:03 -0700 PDT}  }]
May 19 13:00:11.620: INFO: fluentd-cloud-logging-gke-jenkins-e2e-default-pool-b9f48651-wnyy  gke-jenkins-e2e-default-pool-b9f48651-wnyy  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:01 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:23 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:01 -0700 PDT}  }]
May 19 13:00:11.620: INFO: heapster-v1.1.0.beta1-2658213798-030gh                            gke-jenkins-e2e-default-pool-b9f48651-wnyy  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:32 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:37 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:32 -0700 PDT}  }]
May 19 13:00:11.620: INFO: kube-dns-v11-kjqw4                                                gke-jenkins-e2e-default-pool-b9f48651-07l9  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:26 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:53:16 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:26 -0700 PDT}  }]
May 19 13:00:11.620: INFO: kube-proxy-gke-jenkins-e2e-default-pool-b9f48651-07l9             gke-jenkins-e2e-default-pool-b9f48651-07l9  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:03 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:26 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:03 -0700 PDT}  }]
May 19 13:00:11.620: INFO: kube-proxy-gke-jenkins-e2e-default-pool-b9f48651-3w70             gke-jenkins-e2e-default-pool-b9f48651-3w70  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:03 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:20 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:03 -0700 PDT}  }]
May 19 13:00:11.620: INFO: kube-proxy-gke-jenkins-e2e-default-pool-b9f48651-wnyy             gke-jenkins-e2e-default-pool-b9f48651-wnyy  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:01 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:17 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:01 -0700 PDT}  }]
May 19 13:00:11.620: INFO: kubernetes-dashboard-v1.0.1-5fi9o                                 gke-jenkins-e2e-default-pool-b9f48651-wnyy  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:25 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:29 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:25 -0700 PDT}  }]
May 19 13:00:11.620: INFO: l7-lb-controller-v0.6.0-0teyj                                     gke-jenkins-e2e-default-pool-b9f48651-07l9  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:26 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:41 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-19 12:52:26 -0700 PDT}  }]
May 19 13:00:11.620: INFO: 
May 19 13:00:11.626: INFO: 
Logging node info for node gke-jenkins-e2e-default-pool-b9f48651-07l9
May 19 13:00:11.630: INFO: Node Info: kind:"" apiVersion:"" 
May 19 13:00:11.630: INFO: 
Logging kubelet events for node gke-jenkins-e2e-default-pool-b9f48651-07l9
May 19 13:00:11.642: INFO: 
Logging pods the kubelet thinks is on node gke-jenkins-e2e-default-pool-b9f48651-07l9
May 19 13:00:11.670: INFO: l7-lb-controller-v0.6.0-0teyj started at 2016-05-19T12:52:26-07:00 (0+2 container statuses recorded)
May 19 13:00:11.670: INFO:  Container default-http-backend ready: true, restart count 0
May 19 13:00:11.670: INFO:  Container l7-lb-controller ready: true, restart count 0
May 19 13:00:11.670: INFO: foo-07p3z started at 2016-05-19T12:53:19-07:00 (0+1 container statuses recorded)
May 19 13:00:11.670: INFO:  Container c ready: true, restart count 0
May 19 13:00:11.670: INFO: kube-dns-v11-kjqw4 started at 2016-05-19T12:52:26-07:00 (0+4 container statuses recorded)
May 19 13:00:11.670: INFO:  Container etcd ready: true, restart count 0
May 19 13:00:11.670: INFO:  Container healthz ready: true, restart count 0
May 19 13:00:11.670: INFO:  Container kube2sky ready: true, restart count 0
May 19 13:00:11.670: INFO:  Container skydns ready: true, restart count 0
May 19 13:00:11.670: INFO: kube-proxy-gke-jenkins-e2e-default-pool-b9f48651-07l9 started at <nil> (0+0 container statuses recorded)
May 19 13:00:11.670: INFO: test-rollover-controller-sbus0 started at 2016-05-19T12:53:53-07:00 (0+1 container statuses recorded)
May 19 13:00:11.670: INFO:  Container nginx ready: true, restart count 0
May 19 13:00:11.670: INFO: fluentd-cloud-logging-gke-jenkins-e2e-default-pool-b9f48651-07l9 started at <nil> (0+0 container statuses recorded)
May 19 13:00:11.670: INFO: test-rollover-deployment-3104088211-vme5t started at 2016-05-19T12:54:07-07:00 (0+1 container statuses recorded)
May 19 13:00:11.670: INFO:  Container redis ready: true, restart count 0
W0519 13:00:11.687150    4366 metrics_grabber.go:74] Master node is not registered. Grabbing metrics from Scheduler and ControllerManager is disabled.
May 19 13:00:11.867: INFO: 
Latency metrics for node gke-jenkins-e2e-default-pool-b9f48651-07l9
May 19 13:00:11.867: INFO: {Operation: Method:pod_start_latency_microseconds Quantile:0.99 Latency:1m32.575952s}
May 19 13:00:11.867: INFO: {Operation: Method:pod_worker_start_latency_microseconds Quantile:0.99 Latency:1m10.010861s}
May 19 13:00:11.867: INFO: {Operation: Method:pod_start_latency_microseconds Quantile:0.9 Latency:42.670364s}
May 19 13:00:11.867: INFO: {Operation:SyncPod Method:container_manager_latency_microseconds Quantile:0.99 Latency:38.910364s}
May 19 13:00:11.867: INFO: {Operation:stop_container Method:docker_operations_latency_microseconds Quantile:0.99 Latency:30.45333s}
May 19 13:00:11.867: INFO: {Operation:pull_image Method:docker_operations_latency_microseconds Quantile:0.99 Latency:29.760887s}
May 19 13:00:11.867: INFO: {Operation:create Method:pod_worker_latency_microseconds Quantile:0.5 Latency:22.422959s}
May 19 13:00:11.867: INFO: {Operation:create Method:pod_worker_latency_microseconds Quantile:0.99 Latency:22.422959s}
May 19 13:00:11.867: INFO: {Operation:create Method:pod_worker_latency_microseconds Quantile:0.9 Latency:22.422959s}
May 19 13:00:11.867: INFO: {Operation:pull_image Method:docker_operations_latency_microseconds Quantile:0.9 Latency:11.43723s}
May 19 13:00:11.867: INFO: 
Logging node info for node gke-jenkins-e2e-default-pool-b9f48651-3w70
May 19 13:00:11.873: INFO: Node Info: kind:"" apiVersion:"" 
May 19 13:00:11.873: INFO: 
Logging kubelet events for node gke-jenkins-e2e-default-pool-b9f48651-3w70
May 19 13:00:11.886: INFO: 
Logging pods the kubelet thinks is on node gke-jenkins-e2e-default-pool-b9f48651-3w70
May 19 13:00:11.897: INFO: fluentd-cloud-logging-gke-jenkins-e2e-default-pool-b9f48651-3w70 started at <nil> (0+0 container statuses recorded)
May 19 13:00:11.897: INFO: test-rollover-controller-1n0xm started at 2016-05-19T12:53:53-07:00 (0+1 container statuses recorded)
May 19 13:00:11.897: INFO:  Container nginx ready: true, restart count 0
May 19 13:00:11.897: INFO: kube-proxy-gke-jenkins-e2e-default-pool-b9f48651-3w70 started at <nil> (0+0 container statuses recorded)
May 19 13:00:11.897: INFO: foo-bklsf started at 2016-05-19T12:53:18-07:00 (0+1 container statuses recorded)
May 19 13:00:11.897: INFO:  Container c ready: true, restart count 0
May 19 13:00:11.897: INFO: foo-b91ft started at 2016-05-19T12:53:19-07:00 (0+1 container statuses recorded)
May 19 13:00:11.897: INFO:  Container c ready: true, restart count 0
May 19 13:00:11.897: INFO: scale-down-ug6k3 started at 2016-05-19T12:59:20-07:00 (0+1 container statuses recorded)
May 19 13:00:11.897: INFO:  Container c ready: true, restart count 0
May 19 13:00:11.897: INFO: test-rollover-deployment-3104088211-a84by started at 2016-05-19T12:54:33-07:00 (0+1 container statuses recorded)
May 19 13:00:11.897: INFO:  Container redis ready: true, restart count 0
May 19 13:00:11.897: INFO: foo-36hvx started at 2016-05-19T12:53:18-07:00 (0+1 container statuses recorded)
May 19 13:00:11.897: INFO:  Container c ready: true, restart count 0
W0519 13:00:11.903894    4366 metrics_grabber.go:74] Master node is not registered. Grabbing metrics from Scheduler and ControllerManager is disabled.
May 19 13:00:12.121: INFO: 
Latency metrics for node gke-jenkins-e2e-default-pool-b9f48651-3w70
May 19 13:00:12.121: INFO: {Operation: Method:pod_start_latency_microseconds Quantile:0.99 Latency:1m31.570897s}
May 19 13:00:12.121: INFO: {Operation: Method:pod_worker_start_latency_microseconds Quantile:0.99 Latency:1m10.012519s}
May 19 13:00:12.121: INFO: {Operation:SyncPod Method:container_manager_latency_microseconds Quantile:0.99 Latency:44.421537s}
May 19 13:00:12.121: INFO: {Operation: Method:pod_start_latency_microseconds Quantile:0.9 Latency:39.769994s}
May 19 13:00:12.121: INFO: {Operation:stop_container Method:docker_operations_latency_microseconds Quantile:0.99 Latency:30.087359s}
May 19 13:00:12.121: INFO: {Operation:pull_image Method:docker_operations_latency_microseconds Quantile:0.99 Latency:28.185911s}
May 19 13:00:12.121: INFO: {Operation:pull_image Method:docker_operations_latency_microseconds Quantile:0.9 Latency:15.531689s}
May 19 13:00:12.121: INFO: 
Logging node info for node gke-jenkins-e2e-default-pool-b9f48651-wnyy
May 19 13:00:12.126: INFO: Node Info: kind:"" apiVersion:"" 
May 19 13:00:12.126: INFO: 
Logging kubelet events for node gke-jenkins-e2e-default-pool-b9f48651-wnyy
May 19 13:00:12.132: INFO: 
Logging pods the kubelet thinks is on node gke-jenkins-e2e-default-pool-b9f48651-wnyy
May 19 13:00:12.142: INFO: heapster-v1.1.0.beta1-2658213798-030gh started at 2016-05-19T12:52:32-07:00 (0+2 container statuses recorded)
May 19 13:00:12.142: INFO:  Container heapster ready: true, restart count 0
May 19 13:00:12.142: INFO:  Container heapster-nanny ready: true, restart count 0
May 19 13:00:12.142: INFO: test-webserver-fef6df7b-1dfb-11e6-a46c-0242ac110003 started at 2016-05-19T12:58:03-07:00 (0+1 container statuses recorded)
May 19 13:00:12.142: INFO:  Container test-webserber ready: false, restart count 0
May 19 13:00:12.142: INFO: test-rollover-deployment-3104088211-cc8bz started at 2016-05-19T12:54:07-07:00 (0+1 container statuses recorded)
May 19 13:00:12.142: INFO:  Container redis ready: true, restart count 0
May 19 13:00:12.142: INFO: kube-proxy-gke-jenkins-e2e-default-pool-b9f48651-wnyy started at <nil> (0+0 container statuses recorded)
May 19 13:00:12.142: INFO: kubernetes-dashboard-v1.0.1-5fi9o started at 2016-05-19T12:52:25-07:00 (0+1 container statuses recorded)
May 19 13:00:12.142: INFO:  Container kubernetes-dashboard ready: true, restart count 0
May 19 13:00:12.142: INFO: test-rollover-controller-gg7bu started at 2016-05-19T12:53:53-07:00 (0+1 container statuses recorded)
May 19 13:00:12.142: INFO:  Container nginx ready: true, restart count 0
May 19 13:00:12.142: INFO: fluentd-cloud-logging-gke-jenkins-e2e-default-pool-b9f48651-wnyy started at <nil> (0+0 container statuses recorded)
W0519 13:00:12.147396    4366 metrics_grabber.go:74] Master node is not registered. Grabbing metrics from Scheduler and ControllerManager is disabled.
May 19 13:00:12.248: INFO: 
Latency metrics for node gke-jenkins-e2e-default-pool-b9f48651-wnyy
May 19 13:00:12.292: INFO: {Operation: Method:pod_start_latency_microseconds Quantile:0.99 Latency:1m31.690529s}
May 19 13:00:12.292: INFO: {Operation:create Method:pod_worker_latency_microseconds Quantile:0.9 Latency:41.085503s}
May 19 13:00:12.292: INFO: {Operation:create Method:pod_worker_latency_microseconds Quantile:0.99 Latency:41.085503s}
May 19 13:00:12.292: INFO: {Operation:pull_image Method:docker_operations_latency_microseconds Quantile:0.99 Latency:32.599948s}
May 19 13:00:12.292: INFO: {Operation:stop_container Method:docker_operations_latency_microseconds Quantile:0.99 Latency:30.287445s}
May 19 13:00:12.292: INFO: {Operation:SyncPod Method:container_manager_latency_microseconds Quantile:0.99 Latency:26.379942s}
May 19 13:00:12.292: INFO: {Operation: Method:pod_start_latency_microseconds Quantile:0.9 Latency:26.109318s}
May 19 13:00:12.293: INFO: {Operation:pull_image Method:docker_operations_latency_microseconds Quantile:0.9 Latency:17.539384s}
May 19 13:00:12.293: INFO: {Operation:create Method:pod_worker_latency_microseconds Quantile:0.5 Latency:10.652796s}
May 19 13:00:12.293: INFO: Waiting up to 1m0s for all nodes to be ready
STEP: Destroying namespace "e2e-tests-deployment-oybdc" for this suite.

• Failure [383.992 seconds]
[k8s.io] Deployment
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:508
  deployment should support rollover [It]
  /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/deployment.go:71

  Expected error:
      <*errors.errorString | 0xc8207e2040>: {
          s: "error waiting for deployment test-rollover-deployment status to match expectation: timed out waiting for the condition",
      }
      error waiting for deployment test-rollover-deployment status to match expectation: timed out waiting for the condition
  not to have occurred

  /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/deployment.go:560
bgrant0607 commented 8 years ago

cc @kubernetes/deployment

adohe-zz commented 8 years ago

This error is a little bit tricky:

May 19 12:59:11.501: INFO: Deployment: kind:"" apiVersion:"" . Selector = matchLabels:<key:"name" value:"rollover-pod" > 
May 19 12:59:11.501: INFO: All old ReplicaSets (1/2) of deployment test-rollover-deployment: kind:"" apiVersion:"" . Selector = matchLabels:<key:"name" value:"rollover-pod" > matchLabels:<key:"pod" value:"nginx" > matchLabels:<key:"pod-template-hash" value:"1321378927" > 
May 19 12:59:11.502: INFO: All old ReplicaSets (2/2) of deployment test-rollover-deployment: kind:"" apiVersion:"" . Selector = matchLabels:<key:"name" value:"rollover-pod" > matchLabels:<key:"pod-template-hash" value:"3098649686" > 
May 19 12:59:11.502: INFO: New ReplicaSet of deployment test-rollover-deployment: kind:"" apiVersion:"" . Selector = matchLabels:<key:"name" value:"rollover-pod" > matchLabels:<key:"pod-template-hash" value:"3104088211" > 
May 19 12:59:11.509: INFO: Pod test-rollover-controller-1n0xm is available: {TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:test-rollover-controller-1n0xm GenerateName:test-rollover-controller- Namespace:e2e-tests-deployment-oybdc SelfLink:/api/v1/namespaces/e2e-tests-deployment-oybdc/pods/test-rollover-controller-1n0xm UID:6a549fe5-1dfb-11e6-a239-42010af0001e ResourceVersion:2148 Generation:0 CreationTimestamp:{Time:2016-05-19 12:53:53 -0700 PDT} DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[name:rollover-pod pod:nginx pod-template-hash:1321378927] Annotations:map[kubernetes.io/created-by:{"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"e2e-tests-deployment-oybdc","name":"test-rollover-controller","uid":"6a49adea-1dfb-11e6-a239-42010af0001e","apiVersion":"extensions","resourceVersion":"1451"}}
] OwnerReferences:[] Finalizers:[]} Spec:{Volumes:[{Name:default-token-h8oc4 VolumeSource:{HostPath:<nil> EmptyDir:<nil> GCEPersistentDisk:<nil> AWSElasticBlockStore:<nil> GitRepo:<nil> Secret:0xc820bec7e0 NFS:<nil> ISCSI:<nil> Glusterfs:<nil> PersistentVolumeClaim:<nil> RBD:<nil> FlexVolume:<nil> Cinder:<nil> CephFS:<nil> Flocker:<nil> DownwardAPI:<nil> FC:<nil> AzureFile:<nil> ConfigMap:<nil>}}] InitContainers:[] Containers:[{Name:nginx Image:gcr.io/google_containers/nginx:1.7.9 Command:[] Args:[] WorkingDir: Ports:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:default-token-h8oc4 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:<nil> ReadinessProbe:<nil> Lifecycle:<nil> TerminationMessagePath:/dev/termination-log ImagePullPolicy:IfNotPresent SecurityContext:<nil> Stdin:false StdinOnce:false TTY:false}] RestartPolicy:Always TerminationGracePeriodSeconds:0xc820bec7f0 ActiveDeadlineSeconds:<nil> DNSPolicy:ClusterFirst NodeSelector:map[] ServiceAccountName:default NodeName:gke-jenkins-e2e-default-pool-b9f48651-3w70 SecurityContext:0xc820010bc0 ImagePullSecrets:[] Hostname: Subdomain:} Status:{Phase:Running Conditions:[{Type:Initialized Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:53 -0700 PDT} Reason: Message:} {Type:Ready Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:56 -0700 PDT} Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:53 -0700 PDT} Reason: Message:}] Message: Reason: HostIP:10.240.0.5 PodIP:10.180.2.14 StartTime:2016-05-19T12:53:53-07:00 InitContainerStatuses:[] ContainerStatuses:[{Name:nginx State:{Waiting:<nil> Running:0xc820bebb80 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:<nil>} Ready:true RestartCount:0 Image:gcr.io/google_containers/nginx:1.7.9 ImageID:docker://7332861f06d0f1487265e8c3d99bb8800df8e6770e11ad1fe5a7c580362c2a80 ContainerID:docker://fda2a1e9ab67db66a4173a76f5cbc266981ecff08f096f188eff8cbfa04fae77}]}}
May 19 12:59:11.510: INFO: Pod test-rollover-controller-gg7bu is available: {TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:test-rollover-controller-gg7bu GenerateName:test-rollover-controller- Namespace:e2e-tests-deployment-oybdc SelfLink:/api/v1/namespaces/e2e-tests-deployment-oybdc/pods/test-rollover-controller-gg7bu UID:6a505141-1dfb-11e6-a239-42010af0001e ResourceVersion:2151 Generation:0 CreationTimestamp:{Time:2016-05-19 12:53:53 -0700 PDT} DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[name:rollover-pod pod:nginx pod-template-hash:1321378927] Annotations:map[kubernetes.io/created-by:{"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"e2e-tests-deployment-oybdc","name":"test-rollover-controller","uid":"6a49adea-1dfb-11e6-a239-42010af0001e","apiVersion":"extensions","resourceVersion":"1451"}}
] OwnerReferences:[] Finalizers:[]} Spec:{Volumes:[{Name:default-token-h8oc4 VolumeSource:{HostPath:<nil> EmptyDir:<nil> GCEPersistentDisk:<nil> AWSElasticBlockStore:<nil> GitRepo:<nil> Secret:0xc820bec800 NFS:<nil> ISCSI:<nil> Glusterfs:<nil> PersistentVolumeClaim:<nil> RBD:<nil> FlexVolume:<nil> Cinder:<nil> CephFS:<nil> Flocker:<nil> DownwardAPI:<nil> FC:<nil> AzureFile:<nil> ConfigMap:<nil>}}] InitContainers:[] Containers:[{Name:nginx Image:gcr.io/google_containers/nginx:1.7.9 Command:[] Args:[] WorkingDir: Ports:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:default-token-h8oc4 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:<nil> ReadinessProbe:<nil> Lifecycle:<nil> TerminationMessagePath:/dev/termination-log ImagePullPolicy:IfNotPresent SecurityContext:<nil> Stdin:false StdinOnce:false TTY:false}] RestartPolicy:Always TerminationGracePeriodSeconds:0xc820bec7f8 ActiveDeadlineSeconds:<nil> DNSPolicy:ClusterFirst NodeSelector:map[] ServiceAccountName:default NodeName:gke-jenkins-e2e-default-pool-b9f48651-wnyy SecurityContext:0xc820010dc0 ImagePullSecrets:[] Hostname: Subdomain:} Status:{Phase:Running Conditions:[{Type:Initialized Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:53 -0700 PDT} Reason: Message:} {Type:Ready Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:58 -0700 PDT} Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:53 -0700 PDT} Reason: Message:}] Message: Reason: HostIP:10.240.0.4 PodIP:10.180.0.16 StartTime:2016-05-19T12:53:53-07:00 InitContainerStatuses:[] ContainerStatuses:[{Name:nginx State:{Waiting:<nil> Running:0xc820bebbc0 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:<nil>} Ready:true RestartCount:0 Image:gcr.io/google_containers/nginx:1.7.9 ImageID:docker://7332861f06d0f1487265e8c3d99bb8800df8e6770e11ad1fe5a7c580362c2a80 ContainerID:docker://11a24322c7705325a5aa508936368e67faa926c98220e459c91cb8f0450f217a}]}}
May 19 12:59:11.510: INFO: Pod test-rollover-controller-sbus0 is available: {TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:test-rollover-controller-sbus0 GenerateName:test-rollover-controller- Namespace:e2e-tests-deployment-oybdc SelfLink:/api/v1/namespaces/e2e-tests-deployment-oybdc/pods/test-rollover-controller-sbus0 UID:6a54c8a3-1dfb-11e6-a239-42010af0001e ResourceVersion:2159 Generation:0 CreationTimestamp:{Time:2016-05-19 12:53:53 -0700 PDT} DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[pod:nginx pod-template-hash:1321378927 name:rollover-pod] Annotations:map[kubernetes.io/created-by:{"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"e2e-tests-deployment-oybdc","name":"test-rollover-controller","uid":"6a49adea-1dfb-11e6-a239-42010af0001e","apiVersion":"extensions","resourceVersion":"1451"}}
] OwnerReferences:[] Finalizers:[]} Spec:{Volumes:[{Name:default-token-h8oc4 VolumeSource:{HostPath:<nil> EmptyDir:<nil> GCEPersistentDisk:<nil> AWSElasticBlockStore:<nil> GitRepo:<nil> Secret:0xc820bec810 NFS:<nil> ISCSI:<nil> Glusterfs:<nil> PersistentVolumeClaim:<nil> RBD:<nil> FlexVolume:<nil> Cinder:<nil> CephFS:<nil> Flocker:<nil> DownwardAPI:<nil> FC:<nil> AzureFile:<nil> ConfigMap:<nil>}}] InitContainers:[] Containers:[{Name:nginx Image:gcr.io/google_containers/nginx:1.7.9 Command:[] Args:[] WorkingDir: Ports:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:default-token-h8oc4 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:<nil> ReadinessProbe:<nil> Lifecycle:<nil> TerminationMessagePath:/dev/termination-log ImagePullPolicy:IfNotPresent SecurityContext:<nil> Stdin:false StdinOnce:false TTY:false}] RestartPolicy:Always TerminationGracePeriodSeconds:0xc820bec820 ActiveDeadlineSeconds:<nil> DNSPolicy:ClusterFirst NodeSelector:map[] ServiceAccountName:default NodeName:gke-jenkins-e2e-default-pool-b9f48651-07l9 SecurityContext:0xc8200110c0 ImagePullSecrets:[] Hostname: Subdomain:} Status:{Phase:Running Conditions:[{Type:Initialized Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:53 -0700 PDT} Reason: Message:} {Type:Ready Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:55 -0700 PDT} Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:53:54 -0700 PDT} Reason: Message:}] Message: Reason: HostIP:10.240.0.6 PodIP:10.180.1.14 StartTime:2016-05-19T12:53:53-07:00 InitContainerStatuses:[] ContainerStatuses:[{Name:nginx State:{Waiting:<nil> Running:0xc820bebc00 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:<nil>} Ready:true RestartCount:0 Image:gcr.io/google_containers/nginx:1.7.9 ImageID:docker://7332861f06d0f1487265e8c3d99bb8800df8e6770e11ad1fe5a7c580362c2a80 ContainerID:docker://0c45e77b044e4a6afe13f5b4642ca5137baea3adcea14004e95000c080f61057}]}}
May 19 12:59:11.510: INFO: Pod test-rollover-deployment-3104088211-a84by is available: {TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:test-rollover-deployment-3104088211-a84by GenerateName:test-rollover-deployment-3104088211- Namespace:e2e-tests-deployment-oybdc SelfLink:/api/v1/namespaces/e2e-tests-deployment-oybdc/pods/test-rollover-deployment-3104088211-a84by UID:81ca06e1-1dfb-11e6-a239-42010af0001e ResourceVersion:3211 Generation:0 CreationTimestamp:{Time:2016-05-19 12:54:33 -0700 PDT} DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[name:rollover-pod pod-template-hash:3104088211] Annotations:map[kubernetes.io/created-by:{"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"e2e-tests-deployment-oybdc","name":"test-rollover-deployment-3104088211","uid":"7273bd6e-1dfb-11e6-a239-42010af0001e","apiVersion":"extensions","resourceVersion":"3146"}}
] OwnerReferences:[] Finalizers:[]} Spec:{Volumes:[{Name:default-token-h8oc4 VolumeSource:{HostPath:<nil> EmptyDir:<nil> GCEPersistentDisk:<nil> AWSElasticBlockStore:<nil> GitRepo:<nil> Secret:0xc8209a5ea0 NFS:<nil> ISCSI:<nil> Glusterfs:<nil> PersistentVolumeClaim:<nil> RBD:<nil> FlexVolume:<nil> Cinder:<nil> CephFS:<nil> Flocker:<nil> DownwardAPI:<nil> FC:<nil> AzureFile:<nil> ConfigMap:<nil>}}] InitContainers:[] Containers:[{Name:redis Image:gcr.io/google_containers/redis:e2e Command:[] Args:[] WorkingDir: Ports:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:default-token-h8oc4 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:<nil> ReadinessProbe:<nil> Lifecycle:<nil> TerminationMessagePath:/dev/termination-log ImagePullPolicy:IfNotPresent SecurityContext:<nil> Stdin:false StdinOnce:false TTY:false}] RestartPolicy:Always TerminationGracePeriodSeconds:0xc8209a5eb0 ActiveDeadlineSeconds:<nil> DNSPolicy:ClusterFirst NodeSelector:map[] ServiceAccountName:default NodeName:gke-jenkins-e2e-default-pool-b9f48651-3w70 SecurityContext:0xc820a50900 ImagePullSecrets:[] Hostname: Subdomain:} Status:{Phase:Running Conditions:[{Type:Initialized Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:33 -0700 PDT} Reason: Message:} {Type:Ready Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:35 -0700 PDT} Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:33 -0700 PDT} Reason: Message:}] Message: Reason: HostIP:10.240.0.5 PodIP:10.180.2.3 StartTime:2016-05-19T12:54:33-07:00 InitContainerStatuses:[] ContainerStatuses:[{Name:redis State:{Waiting:<nil> Running:0xc820dd8980 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:<nil>} Ready:true RestartCount:0 Image:gcr.io/google_containers/redis:e2e ImageID:docker://e5f6c5a2b5646828f51e8e0d30a2987df7e8183ab2c3ed0ca19eaa03cc5db08c ContainerID:docker://8ccd03769c41cf2757c2eba728342d3ca0024db4c35627738f8ed141b445b47c}]}}
May 19 12:59:11.510: INFO: Pod test-rollover-deployment-3104088211-cc8bz is available: {TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:test-rollover-deployment-3104088211-cc8bz GenerateName:test-rollover-deployment-3104088211- Namespace:e2e-tests-deployment-oybdc SelfLink:/api/v1/namespaces/e2e-tests-deployment-oybdc/pods/test-rollover-deployment-3104088211-cc8bz UID:72a1aa22-1dfb-11e6-a239-42010af0001e ResourceVersion:2399 Generation:0 CreationTimestamp:{Time:2016-05-19 12:54:07 -0700 PDT} DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[name:rollover-pod pod-template-hash:3104088211] Annotations:map[kubernetes.io/created-by:{"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"e2e-tests-deployment-oybdc","name":"test-rollover-deployment-3104088211","uid":"7273bd6e-1dfb-11e6-a239-42010af0001e","apiVersion":"extensions","resourceVersion":"2284"}}
] OwnerReferences:[] Finalizers:[]} Spec:{Volumes:[{Name:default-token-h8oc4 VolumeSource:{HostPath:<nil> EmptyDir:<nil> GCEPersistentDisk:<nil> AWSElasticBlockStore:<nil> GitRepo:<nil> Secret:0xc8209a5ec0 NFS:<nil> ISCSI:<nil> Glusterfs:<nil> PersistentVolumeClaim:<nil> RBD:<nil> FlexVolume:<nil> Cinder:<nil> CephFS:<nil> Flocker:<nil> DownwardAPI:<nil> FC:<nil> AzureFile:<nil> ConfigMap:<nil>}}] InitContainers:[] Containers:[{Name:redis Image:gcr.io/google_containers/redis:e2e Command:[] Args:[] WorkingDir: Ports:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:default-token-h8oc4 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:<nil> ReadinessProbe:<nil> Lifecycle:<nil> TerminationMessagePath:/dev/termination-log ImagePullPolicy:IfNotPresent SecurityContext:<nil> Stdin:false StdinOnce:false TTY:false}] RestartPolicy:Always TerminationGracePeriodSeconds:0xc8209a5eb8 ActiveDeadlineSeconds:<nil> DNSPolicy:ClusterFirst NodeSelector:map[] ServiceAccountName:default NodeName:gke-jenkins-e2e-default-pool-b9f48651-wnyy SecurityContext:0xc820a50980 ImagePullSecrets:[] Hostname: Subdomain:} Status:{Phase:Running Conditions:[{Type:Initialized Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:07 -0700 PDT} Reason: Message:} {Type:Ready Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:08 -0700 PDT} Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:07 -0700 PDT} Reason: Message:}] Message: Reason: HostIP:10.240.0.4 PodIP:10.180.0.15 StartTime:2016-05-19T12:54:07-07:00 InitContainerStatuses:[] ContainerStatuses:[{Name:redis State:{Waiting:<nil> Running:0xc820dd89c0 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:<nil>} Ready:true RestartCount:0 Image:gcr.io/google_containers/redis:e2e ImageID:docker://e5f6c5a2b5646828f51e8e0d30a2987df7e8183ab2c3ed0ca19eaa03cc5db08c ContainerID:docker://8acf88086bb1745f5172731e1f8c1c527c923c3fc0162632f0369e9fc1ec2f0e}]}}
May 19 12:59:11.510: INFO: Pod test-rollover-deployment-3104088211-vme5t is available: {TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:test-rollover-deployment-3104088211-vme5t GenerateName:test-rollover-deployment-3104088211- Namespace:e2e-tests-deployment-oybdc SelfLink:/api/v1/namespaces/e2e-tests-deployment-oybdc/pods/test-rollover-deployment-3104088211-vme5t UID:72a285b7-1dfb-11e6-a239-42010af0001e ResourceVersion:3289 Generation:0 CreationTimestamp:{Time:2016-05-19 12:54:07 -0700 PDT} DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[pod-template-hash:3104088211 name:rollover-pod] Annotations:map[kubernetes.io/created-by:{"kind":"SerializedReference","apiVersion":"v1","reference":{"kind":"ReplicaSet","namespace":"e2e-tests-deployment-oybdc","name":"test-rollover-deployment-3104088211","uid":"7273bd6e-1dfb-11e6-a239-42010af0001e","apiVersion":"extensions","resourceVersion":"2284"}}
] OwnerReferences:[] Finalizers:[]} Spec:{Volumes:[{Name:default-token-h8oc4 VolumeSource:{HostPath:<nil> EmptyDir:<nil> GCEPersistentDisk:<nil> AWSElasticBlockStore:<nil> GitRepo:<nil> Secret:0xc8209a5ed0 NFS:<nil> ISCSI:<nil> Glusterfs:<nil> PersistentVolumeClaim:<nil> RBD:<nil> FlexVolume:<nil> Cinder:<nil> CephFS:<nil> Flocker:<nil> DownwardAPI:<nil> FC:<nil> AzureFile:<nil> ConfigMap:<nil>}}] InitContainers:[] Containers:[{Name:redis Image:gcr.io/google_containers/redis:e2e Command:[] Args:[] WorkingDir: Ports:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:default-token-h8oc4 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:<nil> ReadinessProbe:<nil> Lifecycle:<nil> TerminationMessagePath:/dev/termination-log ImagePullPolicy:IfNotPresent SecurityContext:<nil> Stdin:false StdinOnce:false TTY:false}] RestartPolicy:Always TerminationGracePeriodSeconds:0xc8209a5ee0 ActiveDeadlineSeconds:<nil> DNSPolicy:ClusterFirst NodeSelector:map[] ServiceAccountName:default NodeName:gke-jenkins-e2e-default-pool-b9f48651-07l9 SecurityContext:0xc820a50a00 ImagePullSecrets:[] Hostname: Subdomain:} Status:{Phase:Running Conditions:[{Type:Initialized Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:07 -0700 PDT} Reason: Message:} {Type:Ready Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:39 -0700 PDT} Reason: Message:} {Type:PodScheduled Status:True LastProbeTime:{Time:0001-01-01 00:00:00 +0000 UTC} LastTransitionTime:{Time:2016-05-19 12:54:07 -0700 PDT} Reason: Message:}] Message: Reason: HostIP:10.240.0.6 PodIP:10.180.1.12 StartTime:2016-05-19T12:54:07-07:00 InitContainerStatuses:[] ContainerStatuses:[{Name:redis State:{Waiting:<nil> Running:0xc820dd8a00 Terminated:<nil>} LastTerminationState:{Waiting:<nil> Running:<nil> Terminated:<nil>} Ready:true RestartCount:0 Image:gcr.io/google_containers/redis:e2e ImageID:docker://e5f6c5a2b5646828f51e8e0d30a2987df7e8183ab2c3ed0ca19eaa03cc5db08c ContainerID:docker://f9eb83c777573747dde4a51a7f06ac41958aa03e44e879118922313f19d45c44}]}}

From this we can see there are six pods available, two pods failed to sync:

ay 19 13:00:11.604: INFO: At {2016-05-19 12:54:30 -0700 PDT} - event for test-rollover-deployment-3098649686-izas7: {kubelet gke-jenkins-e2e-default-pool-b9f48651-3w70} FailedSync: Error syncing pod, skipping: failed to "StartContainer" for "redis-slave" with RunContainerError: "GenerateRunContainerOptions: impossible: cannot find the mounted volumes for pod \"test-rollover-deployment-3098649686-izas7_e2e-tests-deployment-oybdc(71ff315a-1dfb-11e6-a239-42010af0001e)\""

May 19 13:00:11.604: INFO: At {2016-05-19 12:54:33 -0700 PDT} - event for test-rollover-deployment-3098649686-nn9hp: {kubelet gke-jenkins-e2e-default-pool-b9f48651-wnyy} FailedSync: Error syncing pod, skipping: failed to "StartContainer" for "redis-slave" with RunContainerError: "GenerateRunContainerOptions: impossible: cannot find the mounted volumes for pod \"test-rollover-deployment-3098649686-nn9hp_e2e-tests-deployment-oybdc(72220963-1dfb-11e6-a239-42010af0001e)\""
janetkuo commented 8 years ago

https://storage.googleapis.com/kubernetes-jenkins/logs/kubernetes-e2e-gce/17442/build-log.txt

Another symptom: 

• Failure [124.574 seconds]
[k8s.io] Deployment
/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:508
  deployment should support rollover [It]
  /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/deployment.go:71

  Expected error:
      <errors.aggregate | len:1, cap:1>: [
          {
              s: "timed out waiting for the condition",
          },
      ]
      timed out waiting for the condition
  not to have occurred

  /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/deployment.go:184

Looks like the deployment reaper timed-out. 

May 22 13:23:52.950: INFO: Deleting deployment test-rollover-deployment
[AfterEach] [k8s.io] Deployment
  /go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:109
STEP: Collecting events from namespace "e2e-tests-deployment-j09bp".
May 22 13:24:58.281: INFO: At {2016-05-22 13:22:59 -0700 PDT} - event for test-rollover-controller: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-controller-pn6ko
May 22 13:24:58.281: INFO: At {2016-05-22 13:22:59 -0700 PDT} - event for test-rollover-controller: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-controller-dfgif
May 22 13:24:58.281: INFO: At {2016-05-22 13:22:59 -0700 PDT} - event for test-rollover-controller: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-controller-1f2em
May 22 13:24:58.281: INFO: At {2016-05-22 13:22:59 -0700 PDT} - event for test-rollover-controller: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-controller-hu6el
May 22 13:24:58.281: INFO: At {2016-05-22 13:22:59 -0700 PDT} - event for test-rollover-controller-1f2em: {default-scheduler } Scheduled: Successfully assigned test-rollover-controller-1f2em to jenkins-e2e-minion-ju9s
May 22 13:24:58.281: INFO: At {2016-05-22 13:22:59 -0700 PDT} - event for test-rollover-controller-dfgif: {default-scheduler } Scheduled: Successfully assigned test-rollover-controller-dfgif to jenkins-e2e-minion-ju9s
May 22 13:24:58.281: INFO: At {2016-05-22 13:22:59 -0700 PDT} - event for test-rollover-controller-hu6el: {default-scheduler } Scheduled: Successfully assigned test-rollover-controller-hu6el to jenkins-e2e-minion-ze0f
May 22 13:24:58.281: INFO: At {2016-05-22 13:22:59 -0700 PDT} - event for test-rollover-controller-pn6ko: {default-scheduler } Scheduled: Successfully assigned test-rollover-controller-pn6ko to jenkins-e2e-minion-nezu
May 22 13:24:58.281: INFO: At {2016-05-22 13:23:00 -0700 PDT} - event for test-rollover-controller-1f2em: {kubelet jenkins-e2e-minion-ju9s} Pulled: Container image "gcr.io/google_containers/nginx:1.7.9" already present on machine
May 22 13:24:58.281: INFO: At {2016-05-22 13:23:00 -0700 PDT} - event for test-rollover-controller-1f2em: {kubelet jenkins-e2e-minion-ju9s} Created: Created container with docker id 573496a0fa25
May 22 13:24:58.281: INFO: At {2016-05-22 13:23:00 -0700 PDT} - event for test-rollover-controller-1f2em: {kubelet jenkins-e2e-minion-ju9s} Started: Started container with docker id 573496a0fa25
May 22 13:24:58.281: INFO: At {2016-05-22 13:23:00 -0700 PDT} - event for test-rollover-controller-dfgif: {kubelet jenkins-e2e-minion-ju9s} Created: Created container with docker id 4446496e2e04
May 22 13:24:58.281: INFO: At {2016-05-22 13:23:00 -0700 PDT} - event for test-rollover-controller-dfgif: {kubelet jenkins-e2e-minion-ju9s} Pulled: Container image "gcr.io/google_containers/nginx:1.7.9" already present on machine
May 22 13:24:58.281: INFO: At {2016-05-22 13:23:00 -0700 PDT} - event for test-rollover-controller-hu6el: {kubelet jenkins-e2e-minion-ze0f} Pulled: Container image "gcr.io/google_containers/nginx:1.7.9" already present on machine
May 22 13:24:58.281: INFO: At {2016-05-22 13:23:00 -0700 PDT} - event for test-rollover-controller-hu6el: {kubelet jenkins-e2e-minion-ze0f} Started: Started container with docker id 4070c87335b8
May 22 13:24:58.281: INFO: At {2016-05-22 13:23:00 -0700 PDT} - event for test-rollover-controller-hu6el: {kubelet jenkins-e2e-minion-ze0f} Created: Created container with docker id 4070c87335b8
May 22 13:24:58.281: INFO: At {2016-05-22 13:23:00 -0700 PDT} - event for test-rollover-controller-pn6ko: {kubelet jenkins-e2e-minion-nezu} Pulled: Container image "gcr.io/google_containers/nginx:1.7.9" already present on machine
May 22 13:24:58.281: INFO: At {2016-05-22 13:23:00 -0700 PDT} - event for test-rollover-controller-pn6ko: {kubelet jenkins-e2e-minion-nezu} Created: Created container with docker id 27d7859b8fe3
May 22 13:24:58.281: INFO: At {2016-05-22 13:23:00 -0700 PDT} - event for test-rollover-controller-pn6ko: {kubelet jenkins-e2e-minion-nezu} Started: Started container with docker id 27d7859b8fe3
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:01 -0700 PDT} - event for test-rollover-controller-dfgif: {kubelet jenkins-e2e-minion-ju9s} Started: Started container with docker id 4446496e2e04
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-controller: {replicaset-controller } SuccessfulDelete: Deleted pod: test-rollover-controller-1f2em
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-controller-1f2em: {kubelet jenkins-e2e-minion-ju9s} FailedSync: Error syncing pod, skipping: error killing pod: failed to "TeardownNetwork" for "test-rollover-controller-1f2em_e2e-tests-deployment-j09bp" with TeardownNetworkError: "Failed to teardown network for pod \"fa2378e8-205a-11e6-a226-42010af00002\" using network plugins \"kubenet\": Error removing container from network: Failed to open /proc/12095/ns/net: open /proc/12095/ns/net: no such file or directory"

May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-controller-1f2em: {kubelet jenkins-e2e-minion-ju9s} Killing: Killing container with docker id 573496a0fa25: Need to kill pod.
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-rollover-deployment-3098649686 to 1
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-rollover-deployment-3098649686 to 2
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-deployment: {deployment-controller } ScalingReplicaSet: Scaled down replica set test-rollover-deployment-3098649686 to 0
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-deployment: {deployment-controller } ScalingReplicaSet: Scaled down replica set test-rollover-controller to 3
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-rollover-deployment-3104088211 to 2
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-deployment-3098649686: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-deployment-3098649686-fbdj9
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-deployment-3098649686: {replicaset-controller } SuccessfulDelete: Deleted pod: test-rollover-deployment-3098649686-fbdj9
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-deployment-3098649686: {replicaset-controller } SuccessfulDelete: Deleted pod: test-rollover-deployment-3098649686-785b9
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-deployment-3098649686: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-deployment-3098649686-785b9
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-deployment-3098649686-785b9: {kubelet jenkins-e2e-minion-nezu} Pulling: pulling image "gcr.io/google_samples/gb-redisslave:v1"
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-deployment-3098649686-785b9: {default-scheduler } Scheduled: Successfully assigned test-rollover-deployment-3098649686-785b9 to jenkins-e2e-minion-nezu
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-deployment-3098649686-fbdj9: {default-scheduler } Scheduled: Successfully assigned test-rollover-deployment-3098649686-fbdj9 to jenkins-e2e-minion-ju9s
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:10 -0700 PDT} - event for test-rollover-deployment-3098649686-fbdj9: {kubelet jenkins-e2e-minion-ju9s} Pulled: Container image "gcr.io/google_samples/gb-redisslave:v1" already present on machine
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:11 -0700 PDT} - event for test-rollover-deployment-3098649686-fbdj9: {kubelet jenkins-e2e-minion-ju9s} Started: Started container with docker id 3920c7984619
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:11 -0700 PDT} - event for test-rollover-deployment-3098649686-fbdj9: {kubelet jenkins-e2e-minion-ju9s} Created: Created container with docker id 3920c7984619
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:11 -0700 PDT} - event for test-rollover-deployment-3104088211: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-deployment-3104088211-tnwi4
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:11 -0700 PDT} - event for test-rollover-deployment-3104088211: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-deployment-3104088211-r55wk
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:11 -0700 PDT} - event for test-rollover-deployment-3104088211-r55wk: {default-scheduler } Scheduled: Successfully assigned test-rollover-deployment-3104088211-r55wk to jenkins-e2e-minion-ze0f
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:11 -0700 PDT} - event for test-rollover-deployment-3104088211-r55wk: {kubelet jenkins-e2e-minion-ze0f} Pulled: Container image "gcr.io/google_containers/redis:e2e" already present on machine
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:11 -0700 PDT} - event for test-rollover-deployment-3104088211-r55wk: {kubelet jenkins-e2e-minion-ze0f} Created: Created container with docker id 7a998ae6c965
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:11 -0700 PDT} - event for test-rollover-deployment-3104088211-tnwi4: {kubelet jenkins-e2e-minion-ju9s} Pulled: Container image "gcr.io/google_containers/redis:e2e" already present on machine
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:11 -0700 PDT} - event for test-rollover-deployment-3104088211-tnwi4: {default-scheduler } Scheduled: Successfully assigned test-rollover-deployment-3104088211-tnwi4 to jenkins-e2e-minion-ju9s
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:11 -0700 PDT} - event for test-rollover-deployment-3104088211-tnwi4: {kubelet jenkins-e2e-minion-ju9s} Created: Created container with docker id d770bdcf9c55
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:12 -0700 PDT} - event for test-rollover-deployment-3104088211-r55wk: {kubelet jenkins-e2e-minion-ze0f} Started: Started container with docker id 7a998ae6c965
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:12 -0700 PDT} - event for test-rollover-deployment-3104088211-tnwi4: {kubelet jenkins-e2e-minion-ju9s} Started: Started container with docker id d770bdcf9c55
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:14 -0700 PDT} - event for test-rollover-deployment-3098649686-fbdj9: {kubelet jenkins-e2e-minion-ju9s} Killing: Killing container with docker id 3920c7984619: Need to kill pod.
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:21 -0700 PDT} - event for test-rollover-deployment-3098649686-785b9: {kubelet jenkins-e2e-minion-nezu} Pulled: Successfully pulled image "gcr.io/google_samples/gb-redisslave:v1"
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:21 -0700 PDT} - event for test-rollover-deployment-3098649686-785b9: {kubelet jenkins-e2e-minion-nezu} FailedSync: Error syncing pod, skipping: failed to "StartContainer" for "redis-slave" with RunContainerError: "GenerateRunContainerOptions: impossible: cannot find the mounted volumes for pod \"test-rollover-deployment-3098649686-785b9_e2e-tests-deployment-j09bp(0046a11c-205b-11e6-a226-42010af00002)\""

May 22 13:24:58.282: INFO: At {2016-05-22 13:23:24 -0700 PDT} - event for test-rollover-controller: {replicaset-controller } SuccessfulDelete: Deleted pod: test-rollover-controller-hu6el
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:24 -0700 PDT} - event for test-rollover-controller: {replicaset-controller } SuccessfulDelete: Deleted pod: test-rollover-controller-dfgif
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:24 -0700 PDT} - event for test-rollover-controller-hu6el: {kubelet jenkins-e2e-minion-ze0f} Killing: Killing container with docker id 4070c87335b8: Need to kill pod.
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:24 -0700 PDT} - event for test-rollover-deployment: {deployment-controller } ScalingReplicaSet: Scaled down replica set test-rollover-controller to 1
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:24 -0700 PDT} - event for test-rollover-deployment: {deployment-controller } ScalingReplicaSet: Scaled up replica set test-rollover-deployment-3104088211 to 4
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:24 -0700 PDT} - event for test-rollover-deployment-3104088211: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-deployment-3104088211-s0dvx
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:24 -0700 PDT} - event for test-rollover-deployment-3104088211: {replicaset-controller } SuccessfulCreate: Created pod: test-rollover-deployment-3104088211-nhiws
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:24 -0700 PDT} - event for test-rollover-deployment-3104088211-nhiws: {default-scheduler } Scheduled: Successfully assigned test-rollover-deployment-3104088211-nhiws to jenkins-e2e-minion-nezu
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:24 -0700 PDT} - event for test-rollover-deployment-3104088211-s0dvx: {default-scheduler } Scheduled: Successfully assigned test-rollover-deployment-3104088211-s0dvx to jenkins-e2e-minion-ze0f
May 22 13:24:58.282: INFO: At {2016-05-22 13:23:25 -0700 PDT} - event for test-rollover-controller-dfgif: {kubelet jenkins-e2e-minion-ju9s} Killing: Killing container with docker id 4446496e2e04: Need to kill pod.
May 22 13:24:58.283: INFO: At {2016-05-22 13:23:25 -0700 PDT} - event for test-rollover-controller-hu6el: {kubelet jenkins-e2e-minion-ze0f} FailedSync: Error syncing pod, skipping: error killing pod: failed to "TeardownNetwork" for "test-rollover-controller-hu6el_e2e-tests-deployment-j09bp" with TeardownNetworkError: "Failed to teardown network for pod \"fa23964c-205a-11e6-a226-42010af00002\" using network plugins \"kubenet\": Error removing container from network: Failed to open /proc/20198/ns/net: open /proc/20198/ns/net: no such file or directory"

May 22 13:24:58.283: INFO: At {2016-05-22 13:23:25 -0700 PDT} - event for test-rollover-deployment-3104088211-nhiws: {kubelet jenkins-e2e-minion-nezu} Created: Created container with docker id 73cbdeb05ba8
May 22 13:24:58.283: INFO: At {2016-05-22 13:23:25 -0700 PDT} - event for test-rollover-deployment-3104088211-nhiws: {kubelet jenkins-e2e-minion-nezu} Pulled: Container image "gcr.io/google_containers/redis:e2e" already present on machine
May 22 13:24:58.283: INFO: At {2016-05-22 13:23:26 -0700 PDT} - event for test-rollover-deployment-3104088211-nhiws: {kubelet jenkins-e2e-minion-nezu} Started: Started container with docker id 73cbdeb05ba8
May 22 13:24:58.283: INFO: At {2016-05-22 13:23:26 -0700 PDT} - event for test-rollover-deployment-3104088211-s0dvx: {kubelet jenkins-e2e-minion-ze0f} Pulled: Container image "gcr.io/google_containers/redis:e2e" already present on machine
May 22 13:24:58.283: INFO: At {2016-05-22 13:23:26 -0700 PDT} - event for test-rollover-deployment-3104088211-s0dvx: {kubelet jenkins-e2e-minion-ze0f} Started: Started container with docker id bd08306c19d3
May 22 13:24:58.283: INFO: At {2016-05-22 13:23:26 -0700 PDT} - event for test-rollover-deployment-3104088211-s0dvx: {kubelet jenkins-e2e-minion-ze0f} Created: Created container with docker id bd08306c19d3
May 22 13:24:58.283: INFO: At {2016-05-22 13:23:52 -0700 PDT} - event for test-rollover-deployment: {deployment-controller } ScalingReplicaSet: Scaled down replica set test-rollover-controller to 0
May 22 13:24:58.283: INFO: At {2016-05-22 13:24:57 -0700 PDT} - event for test-rollover-deployment-3104088211: {replicaset-controller } SuccessfulDelete: Deleted pod: test-rollover-deployment-3104088211-nhiws
May 22 13:24:58.283: INFO: At {2016-05-22 13:24:57 -0700 PDT} - event for test-rollover-deployment-3104088211: {replicaset-controller } SuccessfulDelete: Deleted pod: test-rollover-deployment-3104088211-r55wk
May 22 13:24:58.283: INFO: At {2016-05-22 13:24:57 -0700 PDT} - event for test-rollover-deployment-3104088211: {replicaset-controller } SuccessfulDelete: Deleted pod: test-rollover-deployment-3104088211-s0dvx
May 22 13:24:58.283: INFO: At {2016-05-22 13:24:57 -0700 PDT} - event for test-rollover-deployment-3104088211: {replicaset-controller } SuccessfulDelete: Deleted pod: test-rollover-deployment-3104088211-tnwi4
May 22 13:24:58.283: INFO: At {2016-05-22 13:24:57 -0700 PDT} - event for test-rollover-deployment-3104088211-nhiws: {kubelet jenkins-e2e-minion-nezu} Killing: Killing container with docker id 73cbdeb05ba8: Need to kill pod.
May 22 13:24:58.283: INFO: At {2016-05-22 13:24:57 -0700 PDT} - event for test-rollover-deployment-3104088211-r55wk: {kubelet jenkins-e2e-minion-ze0f} Killing: Killing container with docker id 7a998ae6c965: Need to kill pod.
May 22 13:24:58.283: INFO: At {2016-05-22 13:24:57 -0700 PDT} - event for test-rollover-deployment-3104088211-s0dvx: {kubelet jenkins-e2e-minion-ze0f} Killing: Killing container with docker id bd08306c19d3: Need to kill pod.
May 22 13:24:58.283: INFO: At {2016-05-22 13:24:57 -0700 PDT} - event for test-rollover-deployment-3104088211-tnwi4: {kubelet jenkins-e2e-minion-ju9s} FailedSync: Error syncing pod, skipping: error killing pod: failed to "TeardownNetwork" for "test-rollover-deployment-3104088211-tnwi4_e2e-tests-deployment-j09bp" with TeardownNetworkError: "Failed to teardown network for pod \"00dd4098-205b-11e6-a226-42010af00002\" using network plugins \"kubenet\": Error removing container from network: Failed to open /proc/12747/ns/net: open /proc/12747/ns/net: no such file or directory"

May 22 13:24:58.283: INFO: At {2016-05-22 13:24:57 -0700 PDT} - event for test-rollover-deployment-3104088211-tnwi4: {kubelet jenkins-e2e-minion-ju9s} Killing: Killing container with docker id d770bdcf9c55: Need to kill pod.
May 22 13:24:58.322: INFO: POD                                            NODE                     PHASE    GRACE  CONDITIONS
May 22 13:24:58.322: INFO: test-rollover-controller-pn6ko                 jenkins-e2e-minion-nezu  Running         [{Initialized True {0001-01-01 00:00:00 +0000 UTC} {2016-05-22 13:22:59 -0700 PDT}  } {Ready True {0001-01-01 00:00:00 +0000 UTC} {2016-05-22 13:23:01 -0700 PDT}  } {PodScheduled True {0001-01-01 00:00:00 +0000 UTC} {2016-05-22 13:22:59 -0700 PDT}  }]
0xmichalis commented 8 years ago

The deployment reaper has a bug in that it doesn't recognize correctly notfound errors coming from the scaler. I have a commit (https://github.com/kubernetes/kubernetes/pull/20273/commits/35762336d116bd701f8d2dc7f7f259d77c860958) fixing that in https://github.com/kubernetes/kubernetes/pull/20273 and it may be the issue behind the reaper timeouts (I was seeing those in my pull prior to adding that commit - not anymore. I am just not sure 100% if it was the same as this. If you want, I can roll the commit into a separate pull, get it merged, and see if it fixes this.

fejta commented 8 years ago

Assigning to @bgrant0607 per team/ux label

janetkuo commented 8 years ago

If you want, I can roll the commit into a separate pull, get it merged, and see if it fixes this.

@kargakis yes, that'd help. Thanks!

goltermann commented 8 years ago

@kargakis Any update? This P0 has been open a while.

0xmichalis commented 8 years ago

My fix for this has been merged a while ago: https://github.com/kubernetes/kubernetes/pull/26349 but it is only fixing the flake @janetkuo had observed with the reaper. The error reported originally has to do with the deployment expectations. Assigning back to @bgrant0607 for that part.

pwittrock commented 8 years ago

Recent instances of this:

6/3 https://console.cloud.google.com/storage/browser/kubernetes-jenkins/logs/kubernetes-e2e-gce/18111

5/29 https://console.cloud.google.com/storage/browser/kubernetes-jenkins/logs/kubernetes-e2e-gce/17824

pwittrock commented 8 years ago

This has been opened by the k8s-merge-robot in #26834. Closing as a dup.