search

ovn-org / ovn-kubernetes

A robust Kubernetes networking platform
https://ovn-kubernetes.io/
Apache License 2.0
779 stars 334 forks source link

[Feature:Networking-DNS] should provider Internet connection for containers using DNS fails on IPV6 CI lane. #2798

Closed tssurya closed 2 weeks ago

tssurya commented 2 years ago

[sig-network] should provider Internet connection for containers using DNS [Feature:Networking-DNS] K8s upstream e2e test fails only on IPV6/DualStack: Observed after update to K8sv.1.23.1.

2022-02-04T20:46:35.9284357Z [Fail] [sig-network] Networking [It] should provider Internet connection for containers using DNS [Feature:Networking-DNS]  2022-02-04T20:46:35.9284986Z /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:99 2022-02-04T20:46:35.9285232Z

We need to investigate why this is the case.

tssurya commented 2 years ago 
2022-02-04T20:29:22.8914375Z [It] should provider Internet connection for containers using DNS [Feature:Networking-DNS]
2022-02-04T20:29:22.8914985Z   /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:97
2022-02-04T20:29:22.8915550Z STEP: Running container which tries to connect to google.com
2022-02-04T20:29:22.8916194Z Feb  4 20:29:10.778: INFO: Waiting up to 5m0s for pod "connectivity-test" in namespace "nettest-9428" to be "Succeeded or Failed"
2022-02-04T20:29:22.8916931Z Feb  4 20:29:10.793: INFO: Pod "connectivity-test": Phase="Pending", Reason="", readiness=false. Elapsed: 15.100274ms
2022-02-04T20:29:22.8917716Z Feb  4 20:29:12.798: INFO: Pod "connectivity-test": Phase="Pending", Reason="", readiness=false. Elapsed: 2.020165881s
2022-02-04T20:29:22.8918508Z Feb  4 20:29:14.802: INFO: Pod "connectivity-test": Phase="Pending", Reason="", readiness=false. Elapsed: 4.023528784s
2022-02-04T20:29:22.8919191Z Feb  4 20:29:16.805: INFO: Pod "connectivity-test": Phase="Running", Reason="", readiness=true. Elapsed: 6.027256206s
2022-02-04T20:29:22.8919850Z Feb  4 20:29:18.868: INFO: Pod "connectivity-test": Phase="Running", Reason="", readiness=true. Elapsed: 8.090067509s
2022-02-04T20:29:22.8920488Z Feb  4 20:29:20.872: INFO: Pod "connectivity-test": Phase="Running", Reason="", readiness=true. Elapsed: 10.094057034s
2022-02-04T20:29:22.8921147Z Feb  4 20:29:22.875: INFO: Pod "connectivity-test": Phase="Failed", Reason="", readiness=false. Elapsed: 12.096848753s
2022-02-04T20:29:22.8921705Z Feb  4 20:29:22.879: INFO: pod nettest-9428/connectivity-test logs:
2022-02-04T20:29:22.8922047Z nc: getaddrinfo: Try again
2022-02-04T20:29:22.8922427Z 
2022-02-04T20:29:22.8922969Z Feb  4 20:29:22.880: FAIL: Unexpected error:
2022-02-04T20:29:22.8926230Z     <*errors.errorString | 0xc00297e4a0>: {
2022-02-04T20:29:22.8934653Z         s: "pod \"connectivity-test\" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:10 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:21 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [agnhost-container]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:21 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [agnhost-container]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:10 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:fc00:f853:ccd:e793::3 PodIP:fd00:10:244:3::cd PodIPs:[{IP:fd00:10:244:3::cd}] StartTime:2022-02-04 20:29:10 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:agnhost-container State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:1,Signal:0,Reason:Error,Message:,StartedAt:2022-02-04 20:29:15 +0000 UTC,FinishedAt:2022-02-04 20:29:20 +0000 UTC,ContainerID:containerd://24e99e2d41dd8351df8df986b88d7d8836a7001de5da123e87f130304e94da26,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:k8s.gcr.io/e2e-test-images/agnhost:2.33 ImageID:k8s.gcr.io/e2e-test-images/agnhost@sha256:5b3a9f1c71c09c00649d8374224642ff7029ce91a721ec9132e6ed45fa73fd43 ContainerID:containerd://24e99e2d41dd8351df8df986b88d7d8836a7001de5da123e87f130304e94da26 Started:0xc0024542d5}] QOSClass:BestEffort EphemeralContainerStatuses:[]}",
2022-02-04T20:29:22.8938902Z     }
2022-02-04T20:29:22.8945718Z     pod "connectivity-test" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:10 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:21 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [agnhost-container]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:21 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [agnhost-container]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:10 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:fc00:f853:ccd:e793::3 PodIP:fd00:10:244:3::cd PodIPs:[{IP:fd00:10:244:3::cd}] StartTime:2022-02-04 20:29:10 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:agnhost-container State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:1,Signal:0,Reason:Error,Message:,StartedAt:2022-02-04 20:29:15 +0000 UTC,FinishedAt:2022-02-04 20:29:20 +0000 UTC,ContainerID:containerd://24e99e2d41dd8351df8df986b88d7d8836a7001de5da123e87f130304e94da26,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:k8s.gcr.io/e2e-test-images/agnhost:2.33 ImageID:k8s.gcr.io/e2e-test-images/agnhost@sha256:5b3a9f1c71c09c00649d8374224642ff7029ce91a721ec9132e6ed45fa73fd43 ContainerID:containerd://24e99e2d41dd8351df8df986b88d7d8836a7001de5da123e87f130304e94da26 Started:0xc0024542d5}] QOSClass:BestEffort EphemeralContainerStatuses:[]}
2022-02-04T20:29:22.8948507Z occurred
2022-02-04T20:29:22.8948773Z 
2022-02-04T20:29:22.8949001Z Full Stack Trace
2022-02-04T20:29:22.8949629Z k8s.io/kubernetes/test/e2e/network.glob..func20.3()
2022-02-04T20:29:22.8950158Z    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:99 +0x85
2022-02-04T20:29:22.8950548Z k8s.io/kubernetes/test/e2e.RunE2ETests(0x23f6d57)
2022-02-04T20:29:22.8951033Z    _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e.go:133 +0x697
2022-02-04T20:29:22.8951347Z k8s.io/kubernetes/test/e2e.TestE2E(0x0)
2022-02-04T20:29:22.8951763Z    _output/dockerized/go/src/k8s.io/kubernetes/test/e2e/e2e_test.go:136 +0x19
2022-02-04T20:29:22.8952075Z testing.tRunner(0xc000ba6340, 0x7151da0)
2022-02-04T20:29:22.8952374Z    /usr/local/go/src/testing/testing.go:1259 +0x102
2022-02-04T20:29:22.8952632Z created by testing.(*T).Run
2022-02-04T20:29:22.8952916Z    /usr/local/go/src/testing/testing.go:1306 +0x35a
2022-02-04T20:29:22.8953367Z [AfterEach] [sig-network] Networking
2022-02-04T20:29:22.8953831Z   /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186
2022-02-04T20:29:22.8954231Z Feb  4 20:29:22.881: INFO: Waiting up to 3m0s for all (but 0) nodes to be ready
2022-02-04T20:29:22.8954654Z STEP: Destroying namespace "nettest-9428" for this suite.
2022-02-04T20:29:22.8954836Z 
2022-02-04T20:29:22.8954842Z 
2022-02-04T20:29:22.8955065Z • Failure [12.224 seconds]
2022-02-04T20:29:22.8955338Z [sig-network] Networking
2022-02-04T20:29:22.8955864Z /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/common/framework.go:23
2022-02-04T20:29:22.8956500Z   should provider Internet connection for containers using DNS [Feature:Networking-DNS] [It]
2022-02-04T20:29:22.8957140Z   /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:97
2022-02-04T20:29:22.8957383Z 
2022-02-04T20:29:22.8957797Z   Feb  4 20:29:22.880: Unexpected error:
2022-02-04T20:29:22.8958129Z       <*errors.errorString | 0xc00297e4a0>: {
2022-02-04T20:29:22.8966495Z           s: "pod \"connectivity-test\" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:10 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:21 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [agnhost-container]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:21 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [agnhost-container]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:10 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:fc00:f853:ccd:e793::3 PodIP:fd00:10:244:3::cd PodIPs:[{IP:fd00:10:244:3::cd}] StartTime:2022-02-04 20:29:10 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:agnhost-container State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:1,Signal:0,Reason:Error,Message:,StartedAt:2022-02-04 20:29:15 +0000 UTC,FinishedAt:2022-02-04 20:29:20 +0000 UTC,ContainerID:containerd://24e99e2d41dd8351df8df986b88d7d8836a7001de5da123e87f130304e94da26,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:k8s.gcr.io/e2e-test-images/agnhost:2.33 ImageID:k8s.gcr.io/e2e-test-images/agnhost@sha256:5b3a9f1c71c09c00649d8374224642ff7029ce91a721ec9132e6ed45fa73fd43 ContainerID:containerd://24e99e2d41dd8351df8df986b88d7d8836a7001de5da123e87f130304e94da26 Started:0xc0024542d5}] QOSClass:BestEffort EphemeralContainerStatuses:[]}",
2022-02-04T20:29:22.8968878Z       }
2022-02-04T20:29:22.8987112Z       pod "connectivity-test" failed with status: {Phase:Failed Conditions:[{Type:Initialized Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:10 +0000 UTC Reason: Message:} {Type:Ready Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:21 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [agnhost-container]} {Type:ContainersReady Status:False LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:21 +0000 UTC Reason:ContainersNotReady Message:containers with unready status: [agnhost-container]} {Type:PodScheduled Status:True LastProbeTime:0001-01-01 00:00:00 +0000 UTC LastTransitionTime:2022-02-04 20:29:10 +0000 UTC Reason: Message:}] Message: Reason: NominatedNodeName: HostIP:fc00:f853:ccd:e793::3 PodIP:fd00:10:244:3::cd PodIPs:[{IP:fd00:10:244:3::cd}] StartTime:2022-02-04 20:29:10 +0000 UTC InitContainerStatuses:[] ContainerStatuses:[{Name:agnhost-container State:{Waiting:nil Running:nil Terminated:&ContainerStateTerminated{ExitCode:1,Signal:0,Reason:Error,Message:,StartedAt:2022-02-04 20:29:15 +0000 UTC,FinishedAt:2022-02-04 20:29:20 +0000 UTC,ContainerID:containerd://24e99e2d41dd8351df8df986b88d7d8836a7001de5da123e87f130304e94da26,}} LastTerminationState:{Waiting:nil Running:nil Terminated:nil} Ready:false RestartCount:0 Image:k8s.gcr.io/e2e-test-images/agnhost:2.33 ImageID:k8s.gcr.io/e2e-test-images/agnhost@sha256:5b3a9f1c71c09c00649d8374224642ff7029ce91a721ec9132e6ed45fa73fd43 ContainerID:containerd://24e99e2d41dd8351df8df986b88d7d8836a7001de5da123e87f130304e94da26 Started:0xc0024542d5}] QOSClass:BestEffort EphemeralContainerStatuses:[]}
2022-02-04T20:29:22.8990390Z   occurred
2022-02-04T20:29:22.8990532Z 
2022-02-04T20:29:22.8990841Z   /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/network/networking.go:99
2022-02-04T20:29:22.8991414Z ------------------------------
2022-02-04T20:29:22.9010674Z {"msg":"FAILED [sig-network] Networking should provider Internet connection for containers using DNS [Feature:Networking-DNS]","total":-1,"completed":4,"skipped":185,"failed":5,"failures":["[sig-network] Networking should provider Internet connection for containers using DNS [Feature:Networking-DNS]","[sig-network] Networking should provider Internet connection for containers using DNS [Feature:Networking-DNS]","[sig-network] Networking should provider Internet connection for containers using DNS [Feature:Networking-DNS]","[sig-network] Networking should provider Internet connection for containers using DNS [Feature:Networking-DNS]","[sig-network] Networking should provider Internet connection for containers using DNS [Feature:Networking-DNS]"]}
2022-02-04T20:29:22.9012474Z
github-actions[bot] commented 2 weeks ago

This issue is stale because it has been open 60 days with no activity. Remove stale label or comment or this will be closed in 5 days.

github-actions[bot] commented 2 weeks ago

This issue was closed because it has been stalled for 5 days with no activity.