search

kubernetes-retired / kube-batch

A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC
Apache License 2.0
1.08k stars 264 forks source link

Fix the events for pod failure/success #829

Closed shivramsrivastava closed 5 years ago

shivramsrivastava commented 5 years ago

/kind bug

The Below conformance test fails due to events not being sent from 'kube-batch'. This test case verifies the outcome of the test with the events from the api-server, hence this test case fails.

Need to fix the way 'kube-batch' send pod success and failure events to api-server.

$ ./e2e.test --provider=local --ginkgo.focus="validates resource limits of pods that are allowed to run" --kubeconfig=/home/root1/.kube/config 2>&1  | tee resource_limit_e2e_conformance.log
I0424 21:33:47.223887   25698 e2e.go:240] Starting e2e run "8b115453-4597-44d6-825e-7acd5de34f9b" on Ginkgo node 1
Running Suite: Kubernetes e2e suite
===================================
Random Seed: 1556121826 - Will randomize all specs
Will run 1 of 4082 specs

Apr 24 21:33:47.324: INFO: >>> kubeConfig: /home/root1/.kube/config
Apr 24 21:33:47.326: INFO: Waiting up to 30m0s for all (but 0) nodes to be schedulable
Apr 24 21:33:47.338: INFO: Waiting up to 10m0s for all pods (need at least 0) in namespace 'kube-system' to be running and ready
Apr 24 21:33:47.359: INFO: 13 / 13 pods in namespace 'kube-system' are running and ready (0 seconds elapsed)
Apr 24 21:33:47.359: INFO: expected 2 pod replicas in namespace 'kube-system', 2 are Running and Ready.
Apr 24 21:33:47.359: INFO: Waiting up to 5m0s for all daemonsets in namespace 'kube-system' to start
Apr 24 21:33:47.366: INFO: 4 / 4 pods ready in namespace 'kube-system' in daemonset 'kube-proxy' (0 seconds elapsed)
Apr 24 21:33:47.366: INFO: 4 / 4 pods ready in namespace 'kube-system' in daemonset 'weave-net' (0 seconds elapsed)
Apr 24 21:33:47.366: INFO: e2e test version: v1.15.0-alpha.1.303+8ec6167f61463c
Apr 24 21:33:47.367: INFO: kube-apiserver version: v1.13.4
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[sig-scheduling] SchedulerPredicates [Serial] 
  validates resource limits of pods that are allowed to run  [Conformance]
  /home/root1/kubebapath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:696
[BeforeEach] [sig-scheduling] SchedulerPredicates [Serial]
  /home/root1/kubebapath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:149
STEP: Creating a kubernetes client
Apr 24 21:33:47.389: INFO: >>> kubeConfig: /home/root1/.kube/config
STEP: Building a namespace api object, basename sched-pred
Apr 24 21:33:47.424: INFO: No PodSecurityPolicies found; assuming PodSecurityPolicy is disabled.
STEP: Waiting for a default service account to be provisioned in namespace
[BeforeEach] [sig-scheduling] SchedulerPredicates [Serial]
  /home/root1/kubebapath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/scheduling/predicates.go:79
Apr 24 21:33:47.425: INFO: Waiting up to 1m0s for all (but 0) nodes to be ready
Apr 24 21:33:47.429: INFO: Waiting for terminating namespaces to be deleted...
Apr 24 21:33:47.430: INFO: 
Logging pods the kubelet thinks is on node shiv-worker before test
Apr 24 21:33:47.435: INFO: kube-proxy-kq7c8 from kube-system started at 2019-04-24 11:31:07 +0530 IST (1 container statuses recorded)
Apr 24 21:33:47.435: INFO:  Container kube-proxy ready: true, restart count 0
Apr 24 21:33:47.435: INFO: weave-net-szl8s from kube-system started at 2019-04-24 11:31:08 +0530 IST (2 container statuses recorded)
Apr 24 21:33:47.435: INFO:  Container weave ready: true, restart count 1
Apr 24 21:33:47.435: INFO:  Container weave-npc ready: true, restart count 0
Apr 24 21:33:47.435: INFO: 
Logging pods the kubelet thinks is on node shiv-worker2 before test
Apr 24 21:33:47.438: INFO: kube-proxy-d5sjb from kube-system started at 2019-04-24 11:31:07 +0530 IST (1 container statuses recorded)
Apr 24 21:33:47.438: INFO:  Container kube-proxy ready: true, restart count 0
Apr 24 21:33:47.438: INFO: weave-net-42jd4 from kube-system started at 2019-04-24 11:31:08 +0530 IST (2 container statuses recorded)
Apr 24 21:33:47.438: INFO:  Container weave ready: true, restart count 1
Apr 24 21:33:47.438: INFO:  Container weave-npc ready: true, restart count 0
Apr 24 21:33:47.438: INFO: 
Logging pods the kubelet thinks is on node shiv-worker3 before test
Apr 24 21:33:47.443: INFO: kube-proxy-wt27b from kube-system started at 2019-04-24 11:31:07 +0530 IST (1 container statuses recorded)
Apr 24 21:33:47.443: INFO:  Container kube-proxy ready: true, restart count 0
Apr 24 21:33:47.443: INFO: weave-net-9qj7r from kube-system started at 2019-04-24 11:31:08 +0530 IST (2 container statuses recorded)
Apr 24 21:33:47.443: INFO:  Container weave ready: true, restart count 1
Apr 24 21:33:47.443: INFO:  Container weave-npc ready: true, restart count 0
[It] validates resource limits of pods that are allowed to run  [Conformance]
  /home/root1/kubebapath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:696
STEP: verifying the node has the label node shiv-worker
STEP: verifying the node has the label node shiv-worker2
STEP: verifying the node has the label node shiv-worker3
Apr 24 21:33:47.470: INFO: Pod kube-proxy-d5sjb requesting resource cpu=0m on Node shiv-worker2
Apr 24 21:33:47.470: INFO: Pod kube-proxy-kq7c8 requesting resource cpu=0m on Node shiv-worker
Apr 24 21:33:47.470: INFO: Pod kube-proxy-wt27b requesting resource cpu=0m on Node shiv-worker3
Apr 24 21:33:47.470: INFO: Pod weave-net-42jd4 requesting resource cpu=20m on Node shiv-worker2
Apr 24 21:33:47.470: INFO: Pod weave-net-9qj7r requesting resource cpu=20m on Node shiv-worker3
Apr 24 21:33:47.470: INFO: Pod weave-net-szl8s requesting resource cpu=20m on Node shiv-worker
STEP: Starting Pods to consume most of the cluster CPU.
STEP: Creating another pod that requires unavailable amount of CPU.
STEP: Considering event: 
Type = [Normal], Name = [filler-pod-4af3bc98-e19b-4be1-bbb5-7a889339ce61.159874909504133f], Reason = [Scheduled], Message = [Successfully assigned sched-pred-1775/filler-pod-4af3bc98-e19b-4be1-bbb5-7a889339ce61 to shiv-worker]
STEP: Considering event: 
Type = [Normal], Name = [filler-pod-4af3bc98-e19b-4be1-bbb5-7a889339ce61.159874911b9d9b2f], Reason = [Pulled], Message = [Container image "k8s.gcr.io/pause:3.1" already present on machine]
STEP: Considering event: 
Type = [Normal], Name = [filler-pod-4af3bc98-e19b-4be1-bbb5-7a889339ce61.159874912112fb54], Reason = [Created], Message = [Created container]
STEP: Considering event: 
Type = [Normal], Name = [filler-pod-4af3bc98-e19b-4be1-bbb5-7a889339ce61.159874913059fab9], Reason = [Started], Message = [Started container]
STEP: Considering event: 
Type = [Normal], Name = [filler-pod-6bcbd085-78cf-48b1-93c8-a1982d4c7815.1598749095a7f35f], Reason = [Scheduled], Message = [Successfully assigned sched-pred-1775/filler-pod-6bcbd085-78cf-48b1-93c8-a1982d4c7815 to shiv-worker3]
STEP: Considering event: 
Type = [Normal], Name = [filler-pod-6bcbd085-78cf-48b1-93c8-a1982d4c7815.15987490deb8a23e], Reason = [Pulled], Message = [Container image "k8s.gcr.io/pause:3.1" already present on machine]
STEP: Considering event: 
Type = [Normal], Name = [filler-pod-6bcbd085-78cf-48b1-93c8-a1982d4c7815.15987490e66f506a], Reason = [Created], Message = [Created container]
STEP: Considering event: 
Type = [Normal], Name = [filler-pod-6bcbd085-78cf-48b1-93c8-a1982d4c7815.15987490f577ba86], Reason = [Started], Message = [Started container]
STEP: Considering event: 
Type = [Normal], Name = [filler-pod-a30cbc52-d4c3-4583-90d9-13dce85597a9.1598749095a79517], Reason = [Scheduled], Message = [Successfully assigned sched-pred-1775/filler-pod-a30cbc52-d4c3-4583-90d9-13dce85597a9 to shiv-worker2]
STEP: Considering event: 
Type = [Normal], Name = [filler-pod-a30cbc52-d4c3-4583-90d9-13dce85597a9.159874912df0e6c5], Reason = [Pulled], Message = [Container image "k8s.gcr.io/pause:3.1" already present on machine]
STEP: Considering event: 
Type = [Normal], Name = [filler-pod-a30cbc52-d4c3-4583-90d9-13dce85597a9.1598749134384cb8], Reason = [Created], Message = [Created container]
STEP: Considering event: 
Type = [Normal], Name = [filler-pod-a30cbc52-d4c3-4583-90d9-13dce85597a9.1598749142753108], Reason = [Started], Message = [Started container]
STEP: Considering event: 
Type = [Warning], Name = [additional-pod.1598749183967759], Reason = [Unschedulable], Message = [0 nodes are available]
STEP: removing the label node off the node shiv-worker
STEP: verifying the node doesn't have the label node
STEP: removing the label node off the node shiv-worker2
STEP: verifying the node doesn't have the label node
STEP: removing the label node off the node shiv-worker3
STEP: verifying the node doesn't have the label node
[AfterEach] [sig-scheduling] SchedulerPredicates [Serial]
  /home/root1/kubebapath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:150
STEP: Collecting events from namespace "sched-pred-1775".
STEP: Found 13 events.
Apr 24 21:35:59.553: INFO: At 2019-04-24 21:33:55 +0530 IST - event for filler-pod-4af3bc98-e19b-4be1-bbb5-7a889339ce61: {kube-batch } Scheduled: Successfully assigned sched-pred-1775/filler-pod-4af3bc98-e19b-4be1-bbb5-7a889339ce61 to shiv-worker
Apr 24 21:35:59.553: INFO: At 2019-04-24 21:33:55 +0530 IST - event for filler-pod-6bcbd085-78cf-48b1-93c8-a1982d4c7815: {kube-batch } Scheduled: Successfully assigned sched-pred-1775/filler-pod-6bcbd085-78cf-48b1-93c8-a1982d4c7815 to shiv-worker3
Apr 24 21:35:59.553: INFO: At 2019-04-24 21:33:55 +0530 IST - event for filler-pod-a30cbc52-d4c3-4583-90d9-13dce85597a9: {kube-batch } Scheduled: Successfully assigned sched-pred-1775/filler-pod-a30cbc52-d4c3-4583-90d9-13dce85597a9 to shiv-worker2
Apr 24 21:35:59.553: INFO: At 2019-04-24 21:33:56 +0530 IST - event for filler-pod-6bcbd085-78cf-48b1-93c8-a1982d4c7815: {kubelet shiv-worker3} Pulled: Container image "k8s.gcr.io/pause:3.1" already present on machine
Apr 24 21:35:59.553: INFO: At 2019-04-24 21:33:56 +0530 IST - event for filler-pod-6bcbd085-78cf-48b1-93c8-a1982d4c7815: {kubelet shiv-worker3} Created: Created container
Apr 24 21:35:59.553: INFO: At 2019-04-24 21:33:57 +0530 IST - event for filler-pod-4af3bc98-e19b-4be1-bbb5-7a889339ce61: {kubelet shiv-worker} Pulled: Container image "k8s.gcr.io/pause:3.1" already present on machine
Apr 24 21:35:59.553: INFO: At 2019-04-24 21:33:57 +0530 IST - event for filler-pod-4af3bc98-e19b-4be1-bbb5-7a889339ce61: {kubelet shiv-worker} Created: Created container
Apr 24 21:35:59.553: INFO: At 2019-04-24 21:33:57 +0530 IST - event for filler-pod-6bcbd085-78cf-48b1-93c8-a1982d4c7815: {kubelet shiv-worker3} Started: Started container
Apr 24 21:35:59.553: INFO: At 2019-04-24 21:33:58 +0530 IST - event for filler-pod-4af3bc98-e19b-4be1-bbb5-7a889339ce61: {kubelet shiv-worker} Started: Started container
Apr 24 21:35:59.553: INFO: At 2019-04-24 21:33:58 +0530 IST - event for filler-pod-a30cbc52-d4c3-4583-90d9-13dce85597a9: {kubelet shiv-worker2} Started: Started container
Apr 24 21:35:59.553: INFO: At 2019-04-24 21:33:58 +0530 IST - event for filler-pod-a30cbc52-d4c3-4583-90d9-13dce85597a9: {kubelet shiv-worker2} Pulled: Container image "k8s.gcr.io/pause:3.1" already present on machine
Apr 24 21:35:59.553: INFO: At 2019-04-24 21:33:58 +0530 IST - event for filler-pod-a30cbc52-d4c3-4583-90d9-13dce85597a9: {kubelet shiv-worker2} Created: Created container
Apr 24 21:35:59.553: INFO: At 2019-04-24 21:33:59 +0530 IST - event for additional-pod: {kube-batch } Unschedulable: 0 nodes are available
Apr 24 21:35:59.559: INFO: POD                                              NODE                PHASE    GRACE  CONDITIONS
Apr 24 21:35:59.559: INFO: coredns-86c58d9df4-chr2m                         shiv-control-plane  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:44 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:53 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:53 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:44 +0530 IST  }]
Apr 24 21:35:59.559: INFO: coredns-86c58d9df4-v59wz                         shiv-control-plane  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:44 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:53 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:53 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:44 +0530 IST  }]
Apr 24 21:35:59.559: INFO: etcd-shiv-control-plane                          shiv-control-plane  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:30:07 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:30:48 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:30:48 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:30:07 +0530 IST  }]
Apr 24 21:35:59.559: INFO: kube-apiserver-shiv-control-plane                shiv-control-plane  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:30:07 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:30:48 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:30:48 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:30:07 +0530 IST  }]
Apr 24 21:35:59.559: INFO: kube-controller-manager-shiv-control-plane       shiv-control-plane  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:30:07 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:30:47 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:30:47 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:30:07 +0530 IST  }]
Apr 24 21:35:59.559: INFO: kube-proxy-d5sjb                                 shiv-worker2        Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:07 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:14 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:14 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:07 +0530 IST  }]
Apr 24 21:35:59.559: INFO: kube-proxy-kq7c8                                 shiv-worker         Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:07 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:13 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:13 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:07 +0530 IST  }]
Apr 24 21:35:59.559: INFO: kube-proxy-wt27b                                 shiv-worker3        Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:07 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:12 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:12 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:07 +0530 IST  }]
Apr 24 21:35:59.559: INFO: kube-proxy-xwbbl                                 shiv-control-plane  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:06 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:10 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:10 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:05 +0530 IST  }]
Apr 24 21:35:59.559: INFO: weave-net-42jd4                                  shiv-worker2        Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:08 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:49 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:49 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:08 +0530 IST  }]
Apr 24 21:35:59.559: INFO: weave-net-9qj7r                                  shiv-worker3        Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:08 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:47 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:47 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:07 +0530 IST  }]
Apr 24 21:35:59.559: INFO: weave-net-bxglq                                  shiv-control-plane  Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:06 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:43 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:43 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:05 +0530 IST  }]
Apr 24 21:35:59.559: INFO: weave-net-szl8s                                  shiv-worker         Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:08 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:55 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:55 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 11:31:07 +0530 IST  }]
Apr 24 21:35:59.559: INFO: additional-pod                                                       Pending         [{PodScheduled False 0001-01-01 00:00:00 +0000 UTC 2019-04-24 21:33:59 +0530 IST Unschedulable 0 nodes are available}]
Apr 24 21:35:59.559: INFO: filler-pod-4af3bc98-e19b-4be1-bbb5-7a889339ce61  shiv-worker         Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 21:33:55 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 21:33:58 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 21:33:58 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 21:33:55 +0530 IST  }]
Apr 24 21:35:59.559: INFO: filler-pod-6bcbd085-78cf-48b1-93c8-a1982d4c7815  shiv-worker3        Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 21:33:55 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 21:33:58 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 21:33:58 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 21:33:55 +0530 IST  }]
Apr 24 21:35:59.559: INFO: filler-pod-a30cbc52-d4c3-4583-90d9-13dce85597a9  shiv-worker2        Running         [{Initialized True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 21:33:55 +0530 IST  } {Ready True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 21:33:59 +0530 IST  } {ContainersReady True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 21:33:59 +0530 IST  } {PodScheduled True 0001-01-01 00:00:00 +0000 UTC 2019-04-24 21:33:55 +0530 IST  }]
Apr 24 21:35:59.559: INFO: 
Apr 24 21:35:59.561: INFO: 
Logging node info for node shiv-control-plane
Apr 24 21:35:59.563: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:shiv-control-plane,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/shiv-control-plane,UID:52161dff-6656-11e9-a3ec-02425d6df997,ResourceVersion:73806,Generation:0,CreationTimestamp:2019-04-24 11:30:54 +0530 IST,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/os: linux,kubernetes.io/hostname: shiv-control-plane,node-role.kubernetes.io/master: ,},Annotations:map[string]string{kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock,node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:,DoNotUse_ExternalID:,ProviderID:,Unschedulable:false,Taints:[{node-role.kubernetes.io/master  NoSchedule <nil>}],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{365052162048 0} {<nil>} 356496252Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16688992256 0} {<nil>} 16297844Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{365052162048 0} {<nil>} 356496252Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16688992256 0} {<nil>} 16297844Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-04-24 11:31:46 +0530 IST 2019-04-24 11:31:46 +0530 IST WeaveIsUp Weave pod has set this} {MemoryPressure False 2019-04-24 21:35:49 +0530 IST 2019-04-24 11:30:47 +0530 IST KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-04-24 21:35:49 +0530 IST 2019-04-24 11:30:47 +0530 IST KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-04-24 21:35:49 +0530 IST 2019-04-24 11:30:47 +0530 IST KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-04-24 21:35:49 +0530 IST 2019-04-24 11:31:44 +0530 IST KubeletReady kubelet is posting ready status}],Addresses:[{InternalIP 172.17.0.4} {Hostname shiv-control-plane}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:029fcc5e3f574bf39239c0ded2116b6b,SystemUUID:6AF4B3FF-D1AC-11E5-A113-0C0C7201C0FF,BootID:86f78432-250e-44ca-b33f-622aa1cad5c8,KernelVersion:4.15.0-47-generic,OSImage:Ubuntu 18.04.1 LTS,ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.13.4,KubeProxyVersion:v1.13.4,OperatingSystem:linux,Architecture:amd64,},Images:[{[k8s.gcr.io/etcd:3.2.24] 219655340} {[k8s.gcr.io/kube-apiserver:v1.13.4] 180844658} {[weaveworks/weave-kube:2.5.1] 148146468} {[k8s.gcr.io/kube-controller-manager:v1.13.4] 146109202} {[k8s.gcr.io/kube-proxy:v1.13.4] 80197552} {[k8s.gcr.io/kube-scheduler:v1.13.4] 79557746} {[weaveworks/weave-npc:2.5.1] 49569458} {[k8s.gcr.io/coredns:1.2.6] 40017418} {[k8s.gcr.io/pause:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},}
Apr 24 21:35:59.563: INFO: 
Logging kubelet events for node shiv-control-plane
Apr 24 21:35:59.565: INFO: 
Logging pods the kubelet thinks is on node shiv-control-plane
Apr 24 21:35:59.568: INFO: coredns-86c58d9df4-chr2m started at 2019-04-24 11:31:44 +0530 IST (0+1 container statuses recorded)
Apr 24 21:35:59.568: INFO:  Container coredns ready: true, restart count 0
Apr 24 21:35:59.568: INFO: etcd-shiv-control-plane started at <nil> (0+0 container statuses recorded)
Apr 24 21:35:59.568: INFO: kube-apiserver-shiv-control-plane started at <nil> (0+0 container statuses recorded)
Apr 24 21:35:59.568: INFO: kube-controller-manager-shiv-control-plane started at <nil> (0+0 container statuses recorded)
Apr 24 21:35:59.568: INFO: kube-proxy-xwbbl started at 2019-04-24 11:31:06 +0530 IST (0+1 container statuses recorded)
Apr 24 21:35:59.568: INFO:  Container kube-proxy ready: true, restart count 0
Apr 24 21:35:59.568: INFO: weave-net-bxglq started at 2019-04-24 11:31:06 +0530 IST (0+2 container statuses recorded)
Apr 24 21:35:59.568: INFO:  Container weave ready: true, restart count 1
Apr 24 21:35:59.568: INFO:  Container weave-npc ready: true, restart count 0
Apr 24 21:35:59.568: INFO: coredns-86c58d9df4-v59wz started at 2019-04-24 11:31:44 +0530 IST (0+1 container statuses recorded)
Apr 24 21:35:59.568: INFO:  Container coredns ready: true, restart count 0
W0424 21:35:59.570743   25698 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled.
Apr 24 21:35:59.593: INFO: 
Latency metrics for node shiv-control-plane
Apr 24 21:35:59.593: INFO: 
Logging node info for node shiv-worker
Apr 24 21:35:59.594: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:shiv-worker,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/shiv-worker,UID:5a225e1e-6656-11e9-a3ec-02425d6df997,ResourceVersion:73816,Generation:0,CreationTimestamp:2019-04-24 11:31:07 +0530 IST,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/os: linux,kubernetes.io/hostname: shiv-worker,},Annotations:map[string]string{kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock,node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:,DoNotUse_ExternalID:,ProviderID:,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{365052162048 0} {<nil>} 356496252Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16688992256 0} {<nil>} 16297844Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{365052162048 0} {<nil>} 356496252Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16688992256 0} {<nil>} 16297844Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-04-24 11:31:52 +0530 IST 2019-04-24 11:31:52 +0530 IST WeaveIsUp Weave pod has set this} {MemoryPressure False 2019-04-24 21:35:56 +0530 IST 2019-04-24 11:31:07 +0530 IST KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-04-24 21:35:56 +0530 IST 2019-04-24 11:31:07 +0530 IST KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-04-24 21:35:56 +0530 IST 2019-04-24 11:31:07 +0530 IST KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-04-24 21:35:56 +0530 IST 2019-04-24 11:32:00 +0530 IST KubeletReady kubelet is posting ready status}],Addresses:[{InternalIP 172.17.0.3} {Hostname shiv-worker}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:fedb8b69e759436b84b2b60fe2b1bda4,SystemUUID:6AF4B3FF-D1AC-11E5-A113-0C0C7201C0FF,BootID:86f78432-250e-44ca-b33f-622aa1cad5c8,KernelVersion:4.15.0-47-generic,OSImage:Ubuntu 18.04.1 LTS,ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.13.4,KubeProxyVersion:v1.13.4,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6] 373099368} {[k8s.gcr.io/etcd:3.2.24] 219655340} {[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0] 195659796} {[k8s.gcr.io/kube-apiserver:v1.13.4] 180844658} {[weaveworks/weave-kube:2.5.1] 148146468} {[k8s.gcr.io/kube-controller-manager:v1.13.4] 146109202} {[nginx@sha256:e71b1bf4281f25533cf15e6e5f9be4dac74d2328152edf7ecde23abc54e16c1c nginx:latest] 109336766} {[k8s.gcr.io/kube-proxy:v1.13.4] 80197552} {[k8s.gcr.io/kube-scheduler:v1.13.4] 79557746} {[weaveworks/weave-npc:2.5.1] 49569458} {[k8s.gcr.io/coredns:1.2.6] 40017418} {[nginx@sha256:61e3db30b1334b1fa0a2e71b86625188f76653565d515d5f74ecc55a8fb91ce9 nginx:1.15-alpine] 16087791} {[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine] 16032814} {[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1] 9349974} {[gcr.io/kubernetes-e2e-test-images/hostexec@sha256:90dfe59da029f9e536385037bc64e86cd3d6e55bae613ddbe69e554d79b0639d gcr.io/kubernetes-e2e-test-images/hostexec:1.1] 8490662} {[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0] 6757579} {[gcr.io/kubernetes-e2e-test-images/netexec@sha256:203f0e11dde4baf4b08e27de094890eb3447d807c8b3e990b764b799d3a9e8b7 gcr.io/kubernetes-e2e-test-images/netexec:1.1] 6705349} {[gcr.io/kubernetes-e2e-test-images/redis@sha256:af4748d1655c08dc54d4be5182135395db9ce87aba2d4699b26b14ae197c5830 gcr.io/kubernetes-e2e-test-images/redis:1.0] 5905732} {[gcr.io/kubernetes-e2e-test-images/liveness@sha256:71c3fc838e0637df570497febafa0ee73bf47176dfd43612de5c55a71230674e gcr.io/kubernetes-e2e-test-images/liveness:1.1] 5829944} {[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0] 4732240} {[gcr.io/kubernetes-e2e-test-images/porter@sha256:d6389405e453950618ae7749d9eee388f0eb32e0328a7e6583c41433aa5f2a77 gcr.io/kubernetes-e2e-test-images/porter:1.0] 4681408} {[gcr.io/kubernetes-e2e-test-images/entrypoint-tester@sha256:ba4681b5299884a3adca70fbde40638373b437a881055ffcd0935b5f43eb15c9 gcr.io/kubernetes-e2e-test-images/entrypoint-tester:1.0] 2729534} {[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0] 1563521} {[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0] 1450451} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},}
Apr 24 21:35:59.594: INFO: 
Logging kubelet events for node shiv-worker
Apr 24 21:35:59.596: INFO: 
Logging pods the kubelet thinks is on node shiv-worker
Apr 24 21:35:59.599: INFO: weave-net-szl8s started at 2019-04-24 11:31:08 +0530 IST (0+2 container statuses recorded)
Apr 24 21:35:59.599: INFO:  Container weave ready: true, restart count 1
Apr 24 21:35:59.599: INFO:  Container weave-npc ready: true, restart count 0
Apr 24 21:35:59.599: INFO: filler-pod-4af3bc98-e19b-4be1-bbb5-7a889339ce61 started at 2019-04-24 21:33:55 +0530 IST (0+1 container statuses recorded)
Apr 24 21:35:59.599: INFO:  Container filler-pod-4af3bc98-e19b-4be1-bbb5-7a889339ce61 ready: true, restart count 0
Apr 24 21:35:59.599: INFO: kube-proxy-kq7c8 started at 2019-04-24 11:31:07 +0530 IST (0+1 container statuses recorded)
Apr 24 21:35:59.599: INFO:  Container kube-proxy ready: true, restart count 0
W0424 21:35:59.601837   25698 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled.
Apr 24 21:35:59.618: INFO: 
Latency metrics for node shiv-worker
Apr 24 21:35:59.618: INFO: 
Logging node info for node shiv-worker2
Apr 24 21:35:59.620: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:shiv-worker2,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/shiv-worker2,UID:5a0f0be4-6656-11e9-a3ec-02425d6df997,ResourceVersion:73817,Generation:0,CreationTimestamp:2019-04-24 11:31:07 +0530 IST,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/os: linux,kubernetes.io/hostname: shiv-worker2,},Annotations:map[string]string{kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock,node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:,DoNotUse_ExternalID:,ProviderID:,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{365052162048 0} {<nil>} 356496252Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16688992256 0} {<nil>} 16297844Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{365052162048 0} {<nil>} 356496252Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16688992256 0} {<nil>} 16297844Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-04-24 11:31:46 +0530 IST 2019-04-24 11:31:46 +0530 IST WeaveIsUp Weave pod has set this} {MemoryPressure False 2019-04-24 21:35:55 +0530 IST 2019-04-24 11:31:07 +0530 IST KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-04-24 21:35:55 +0530 IST 2019-04-24 11:31:07 +0530 IST KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-04-24 21:35:55 +0530 IST 2019-04-24 11:31:07 +0530 IST KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-04-24 21:35:55 +0530 IST 2019-04-24 11:31:47 +0530 IST KubeletReady kubelet is posting ready status}],Addresses:[{InternalIP 172.17.0.2} {Hostname shiv-worker2}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:28a59ee123d044d1bc08dba705c0293d,SystemUUID:6AF4B3FF-D1AC-11E5-A113-0C0C7201C0FF,BootID:86f78432-250e-44ca-b33f-622aa1cad5c8,KernelVersion:4.15.0-47-generic,OSImage:Ubuntu 18.04.1 LTS,ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.13.4,KubeProxyVersion:v1.13.4,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6] 373099368} {[k8s.gcr.io/etcd:3.2.24] 219655340} {[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0] 195659796} {[k8s.gcr.io/kube-apiserver:v1.13.4] 180844658} {[weaveworks/weave-kube:2.5.1] 148146468} {[k8s.gcr.io/kube-controller-manager:v1.13.4] 146109202} {[nginx@sha256:e71b1bf4281f25533cf15e6e5f9be4dac74d2328152edf7ecde23abc54e16c1c nginx:latest] 109336766} {[gcr.io/google-samples/gb-redisslave@sha256:57730a481f97b3321138161ba2c8c9ca3b32df32ce9180e4029e6940446800ec gcr.io/google-samples/gb-redisslave:v3] 98945667} {[nginx@sha256:e3456c851a152494c3e4ff5fcc26f240206abac0c9d794affb40e0714846c451 nginx:1.7.9] 91664166} {[k8s.gcr.io/kube-proxy:v1.13.4] 80197552} {[k8s.gcr.io/kube-scheduler:v1.13.4] 79557746} {[weaveworks/weave-npc:2.5.1] 49569458} {[k8s.gcr.io/coredns:1.2.6] 40017418} {[nginx@sha256:61e3db30b1334b1fa0a2e71b86625188f76653565d515d5f74ecc55a8fb91ce9 nginx:1.15-alpine] 16087791} {[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine] 16032814} {[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1] 9349974} {[gcr.io/kubernetes-e2e-test-images/netexec@sha256:203f0e11dde4baf4b08e27de094890eb3447d807c8b3e990b764b799d3a9e8b7 gcr.io/kubernetes-e2e-test-images/netexec:1.1] 6705349} {[gcr.io/kubernetes-e2e-test-images/redis@sha256:af4748d1655c08dc54d4be5182135395db9ce87aba2d4699b26b14ae197c5830 gcr.io/kubernetes-e2e-test-images/redis:1.0] 5905732} {[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0] 4753501} {[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0] 4747037} {[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0] 4732240} {[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0] 1563521} {[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0] 1450451} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},}
Apr 24 21:35:59.620: INFO: 
Logging kubelet events for node shiv-worker2
Apr 24 21:35:59.622: INFO: 
Logging pods the kubelet thinks is on node shiv-worker2
Apr 24 21:35:59.624: INFO: filler-pod-a30cbc52-d4c3-4583-90d9-13dce85597a9 started at 2019-04-24 21:33:55 +0530 IST (0+1 container statuses recorded)
Apr 24 21:35:59.624: INFO:  Container filler-pod-a30cbc52-d4c3-4583-90d9-13dce85597a9 ready: true, restart count 0
Apr 24 21:35:59.624: INFO: weave-net-42jd4 started at 2019-04-24 11:31:08 +0530 IST (0+2 container statuses recorded)
Apr 24 21:35:59.624: INFO:  Container weave ready: true, restart count 1
Apr 24 21:35:59.624: INFO:  Container weave-npc ready: true, restart count 0
Apr 24 21:35:59.624: INFO: kube-proxy-d5sjb started at 2019-04-24 11:31:07 +0530 IST (0+1 container statuses recorded)
Apr 24 21:35:59.624: INFO:  Container kube-proxy ready: true, restart count 0
W0424 21:35:59.627123   25698 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled.
Apr 24 21:35:59.642: INFO: 
Latency metrics for node shiv-worker2
Apr 24 21:35:59.642: INFO: 
Logging node info for node shiv-worker3
Apr 24 21:35:59.645: INFO: Node Info: &Node{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:shiv-worker3,GenerateName:,Namespace:,SelfLink:/api/v1/nodes/shiv-worker3,UID:59f2969c-6656-11e9-a3ec-02425d6df997,ResourceVersion:73818,Generation:0,CreationTimestamp:2019-04-24 11:31:07 +0530 IST,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{beta.kubernetes.io/arch: amd64,beta.kubernetes.io/os: linux,kubernetes.io/hostname: shiv-worker3,},Annotations:map[string]string{kubeadm.alpha.kubernetes.io/cri-socket: /var/run/dockershim.sock,node.alpha.kubernetes.io/ttl: 0,volumes.kubernetes.io/controller-managed-attach-detach: true,},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,ManagedFields:[],},Spec:NodeSpec{PodCIDR:,DoNotUse_ExternalID:,ProviderID:,Unschedulable:false,Taints:[],ConfigSource:nil,},Status:NodeStatus{Capacity:ResourceList{cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{365052162048 0} {<nil>} 356496252Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16688992256 0} {<nil>} 16297844Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Allocatable:ResourceList{cpu: {{4 0} {<nil>} 4 DecimalSI},ephemeral-storage: {{365052162048 0} {<nil>} 356496252Ki BinarySI},hugepages-1Gi: {{0 0} {<nil>} 0 DecimalSI},hugepages-2Mi: {{0 0} {<nil>} 0 DecimalSI},memory: {{16688992256 0} {<nil>} 16297844Ki BinarySI},pods: {{110 0} {<nil>} 110 DecimalSI},},Phase:,Conditions:[{NetworkUnavailable False 2019-04-24 11:31:46 +0530 IST 2019-04-24 11:31:46 +0530 IST WeaveIsUp Weave pod has set this} {MemoryPressure False 2019-04-24 21:35:56 +0530 IST 2019-04-24 11:31:07 +0530 IST KubeletHasSufficientMemory kubelet has sufficient memory available} {DiskPressure False 2019-04-24 21:35:56 +0530 IST 2019-04-24 11:31:07 +0530 IST KubeletHasNoDiskPressure kubelet has no disk pressure} {PIDPressure False 2019-04-24 21:35:56 +0530 IST 2019-04-24 11:31:07 +0530 IST KubeletHasSufficientPID kubelet has sufficient PID available} {Ready True 2019-04-24 21:35:56 +0530 IST 2019-04-24 11:32:00 +0530 IST KubeletReady kubelet is posting ready status}],Addresses:[{InternalIP 172.17.0.5} {Hostname shiv-worker3}],DaemonEndpoints:NodeDaemonEndpoints{KubeletEndpoint:DaemonEndpoint{Port:10250,},},NodeInfo:NodeSystemInfo{MachineID:c01b069afe0742bf88c3a4fa737d7c77,SystemUUID:6AF4B3FF-D1AC-11E5-A113-0C0C7201C0FF,BootID:86f78432-250e-44ca-b33f-622aa1cad5c8,KernelVersion:4.15.0-47-generic,OSImage:Ubuntu 18.04.1 LTS,ContainerRuntimeVersion:docker://18.6.3,KubeletVersion:v1.13.4,KubeProxyVersion:v1.13.4,OperatingSystem:linux,Architecture:amd64,},Images:[{[gcr.io/google-samples/gb-frontend@sha256:35cb427341429fac3df10ff74600ea73e8ec0754d78f9ce89e0b4f3d70d53ba6 gcr.io/google-samples/gb-frontend:v6] 373099368} {[k8s.gcr.io/etcd@sha256:17da501f5d2a675be46040422a27b7cc21b8a43895ac998b171db1c346f361f7 k8s.gcr.io/etcd:3.3.10] 258116302} {[k8s.gcr.io/etcd:3.2.24] 219655340} {[gcr.io/kubernetes-e2e-test-images/jessie-dnsutils@sha256:ad583e33cb284f7ef046673809b146ec4053cda19b54a85d2b180a86169715eb gcr.io/kubernetes-e2e-test-images/jessie-dnsutils:1.0] 195659796} {[k8s.gcr.io/kube-apiserver:v1.13.4] 180844658} {[weaveworks/weave-kube:2.5.1] 148146468} {[k8s.gcr.io/kube-controller-manager:v1.13.4] 146109202} {[nginx@sha256:e71b1bf4281f25533cf15e6e5f9be4dac74d2328152edf7ecde23abc54e16c1c nginx:latest] 109336766} {[gcr.io/google-samples/gb-redisslave@sha256:57730a481f97b3321138161ba2c8c9ca3b32df32ce9180e4029e6940446800ec gcr.io/google-samples/gb-redisslave:v3] 98945667} {[nginx@sha256:e3456c851a152494c3e4ff5fcc26f240206abac0c9d794affb40e0714846c451 nginx:1.7.9] 91664166} {[k8s.gcr.io/kube-proxy:v1.13.4] 80197552} {[k8s.gcr.io/kube-scheduler:v1.13.4] 79557746} {[gcr.io/kubernetes-e2e-test-images/sample-apiserver@sha256:1bafcc6fb1aa990b487850adba9cadc020e42d7905aa8a30481182a477ba24b0 gcr.io/kubernetes-e2e-test-images/sample-apiserver:1.10] 61365829} {[weaveworks/weave-npc:2.5.1] 49569458} {[gcr.io/google-containers/debian-base@sha256:6966a0aedd7592c18ff2dd803c08bd85780ee19f5e3a2e7cf908a4cd837afcde gcr.io/google-containers/debian-base:0.4.1] 42323657} {[k8s.gcr.io/coredns:1.2.6] 40017418} {[gcr.io/kubernetes-e2e-test-images/nettest@sha256:6aa91bc71993260a87513e31b672ec14ce84bc253cd5233406c6946d3a8f55a1 gcr.io/kubernetes-e2e-test-images/nettest:1.0] 27413498} {[nginx@sha256:61e3db30b1334b1fa0a2e71b86625188f76653565d515d5f74ecc55a8fb91ce9 nginx:1.15-alpine] 16087791} {[nginx@sha256:485b610fefec7ff6c463ced9623314a04ed67e3945b9c08d7e53a47f6d108dc7 nginx:1.14-alpine] 16032814} {[gcr.io/kubernetes-e2e-test-images/dnsutils@sha256:2abeee84efb79c14d731966e034af33bf324d3b26ca28497555511ff094b3ddd gcr.io/kubernetes-e2e-test-images/dnsutils:1.1] 9349974} {[gcr.io/kubernetes-e2e-test-images/hostexec@sha256:90dfe59da029f9e536385037bc64e86cd3d6e55bae613ddbe69e554d79b0639d gcr.io/kubernetes-e2e-test-images/hostexec:1.1] 8490662} {[gcr.io/kubernetes-e2e-test-images/nonewprivs@sha256:10066e9039219449fe3c81f38fe01928f87914150768ab81b62a468e51fa7411 gcr.io/kubernetes-e2e-test-images/nonewprivs:1.0] 6757579} {[gcr.io/kubernetes-e2e-test-images/netexec@sha256:203f0e11dde4baf4b08e27de094890eb3447d807c8b3e990b764b799d3a9e8b7 gcr.io/kubernetes-e2e-test-images/netexec:1.1] 6705349} {[gcr.io/kubernetes-e2e-test-images/redis@sha256:af4748d1655c08dc54d4be5182135395db9ce87aba2d4699b26b14ae197c5830 gcr.io/kubernetes-e2e-test-images/redis:1.0] 5905732} {[gcr.io/kubernetes-e2e-test-images/serve-hostname@sha256:bab70473a6d8ef65a22625dc9a1b0f0452e811530fdbe77e4408523460177ff1 gcr.io/kubernetes-e2e-test-images/serve-hostname:1.1] 5851985} {[gcr.io/kubernetes-e2e-test-images/liveness@sha256:71c3fc838e0637df570497febafa0ee73bf47176dfd43612de5c55a71230674e gcr.io/kubernetes-e2e-test-images/liveness:1.1] 5829944} {[gcr.io/kubernetes-e2e-test-images/nautilus@sha256:33a732d4c42a266912a5091598a0f07653c9134db4b8d571690d8afd509e0bfc gcr.io/kubernetes-e2e-test-images/nautilus:1.0] 4753501} {[gcr.io/kubernetes-e2e-test-images/kitten@sha256:bcbc4875c982ab39aa7c4f6acf4a287f604e996d9f34a3fbda8c3d1a7457d1f6 gcr.io/kubernetes-e2e-test-images/kitten:1.0] 4747037} {[gcr.io/kubernetes-e2e-test-images/test-webserver@sha256:7f93d6e32798ff28bc6289254d0c2867fe2c849c8e46edc50f8624734309812e gcr.io/kubernetes-e2e-test-images/test-webserver:1.0] 4732240} {[gcr.io/authenticated-image-pulling/alpine@sha256:7ff177862cb50c602bfe81f805969412e619c054a2bbead977d0c276988aa4a0 gcr.io/authenticated-image-pulling/alpine:3.7] 4206620} {[alpine@sha256:fea30b82fd63049b797ab37f13bf9772b59c15a36b1eec6b031b6e483fd7f252 alpine:3.7] 4206494} {[gcr.io/kubernetes-e2e-test-images/entrypoint-tester@sha256:ba4681b5299884a3adca70fbde40638373b437a881055ffcd0935b5f43eb15c9 gcr.io/kubernetes-e2e-test-images/entrypoint-tester:1.0] 2729534} {[gcr.io/kubernetes-e2e-test-images/mounttest@sha256:c0bd6f0755f42af09a68c9a47fb993136588a76b3200ec305796b60d629d85d2 gcr.io/kubernetes-e2e-test-images/mounttest:1.0] 1563521} {[gcr.io/kubernetes-e2e-test-images/mounttest-user@sha256:17319ca525ee003681fccf7e8c6b1b910ff4f49b653d939ac7f9b6e7c463933d gcr.io/kubernetes-e2e-test-images/mounttest-user:1.0] 1450451} {[busybox@sha256:8ccbac733d19c0dd4d70b4f0c1e12245b5fa3ad24758a11035ee505c629c0796 busybox:1.29] 1154361} {[k8s.gcr.io/pause:3.1] 742472}],VolumesInUse:[],VolumesAttached:[],Config:nil,},}
Apr 24 21:35:59.646: INFO: 
Logging kubelet events for node shiv-worker3
Apr 24 21:35:59.648: INFO: 
Logging pods the kubelet thinks is on node shiv-worker3
Apr 24 21:35:59.651: INFO: kube-proxy-wt27b started at 2019-04-24 11:31:07 +0530 IST (0+1 container statuses recorded)
Apr 24 21:35:59.651: INFO:  Container kube-proxy ready: true, restart count 0
Apr 24 21:35:59.651: INFO: weave-net-9qj7r started at 2019-04-24 11:31:08 +0530 IST (0+2 container statuses recorded)
Apr 24 21:35:59.651: INFO:  Container weave ready: true, restart count 1
Apr 24 21:35:59.651: INFO:  Container weave-npc ready: true, restart count 0
Apr 24 21:35:59.652: INFO: filler-pod-6bcbd085-78cf-48b1-93c8-a1982d4c7815 started at 2019-04-24 21:33:55 +0530 IST (0+1 container statuses recorded)
Apr 24 21:35:59.652: INFO:  Container filler-pod-6bcbd085-78cf-48b1-93c8-a1982d4c7815 ready: true, restart count 0
W0424 21:35:59.654109   25698 metrics_grabber.go:79] Master node is not registered. Grabbing metrics from Scheduler, ControllerManager and ClusterAutoscaler is disabled.
Apr 24 21:35:59.670: INFO: 
Latency metrics for node shiv-worker3
Apr 24 21:35:59.670: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
STEP: Destroying namespace "sched-pred-1775" for this suite.
Apr 24 21:36:05.684: INFO: Waiting up to 30s for server preferred namespaced resources to be successfully discovered
Apr 24 21:36:05.755: INFO: namespace sched-pred-1775 deletion completed in 6.08290512s
[AfterEach] [sig-scheduling] SchedulerPredicates [Serial]
  /home/root1/kubebapath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/scheduling/predicates.go:70

• Failure [138.366 seconds]
[sig-scheduling] SchedulerPredicates [Serial]
/home/root1/kubebapath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/scheduling/framework.go:22
  validates resource limits of pods that are allowed to run  [Conformance] [It]
  /home/root1/kubebapath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:696

  Unexpected error:
      <*errors.errorString | 0xc000299490>: {
          s: "timed out waiting for the condition",
      }
      timed out waiting for the condition
  occurred

  /home/root1/kubebapath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/scheduling/predicates.go:714
------------------------------
SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSApr 24 21:36:05.758: INFO: Running AfterSuite actions on all nodes
Apr 24 21:36:05.758: INFO: Running AfterSuite actions on node 1

Summarizing 1 Failure:

[Fail] [sig-scheduling] SchedulerPredicates [Serial] [It] validates resource limits of pods that are allowed to run  [Conformance] 
/home/root1/kubebapath/src/k8s.io/kubernetes/_output/local/go/src/k8s.io/kubernetes/test/e2e/scheduling/predicates.go:714

Ran 1 of 4082 Specs in 138.438 seconds
FAIL! -- 0 Passed | 1 Failed | 0 Pending | 4081 Skipped
--- FAIL: TestE2E (138.54s)
FAIL
shivramsrivastava commented 5 years ago

/assign

k82cn commented 5 years ago

/sig scheduling

@shivramsrivastava , how about the progress?

shivramsrivastava commented 5 years ago

@k82cn please refer the PR #839

fejta-bot commented 5 years ago

Issues go stale after 90d of inactivity. Mark the issue as fresh with /remove-lifecycle stale. Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta. /lifecycle stale

fejta-bot commented 5 years ago

Stale issues rot after 30d of inactivity. Mark the issue as fresh with /remove-lifecycle rotten. Rotten issues close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta. /lifecycle rotten

fejta-bot commented 5 years ago

Rotten issues close after 30d of inactivity. Reopen the issue with /reopen. Mark the issue as fresh with /remove-lifecycle rotten.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta. /close

k8s-ci-robot commented 5 years ago

@fejta-bot: Closing this issue.

In response to [this](https://github.com/kubernetes-sigs/kube-batch/issues/829#issuecomment-536296713): >Rotten issues close after 30d of inactivity. >Reopen the issue with `/reopen`. >Mark the issue as fresh with `/remove-lifecycle rotten`. > >Send feedback to sig-testing, kubernetes/test-infra and/or [fejta](https://github.com/fejta). >/close Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.