search

oomichi / try-kubernetes

12 stars 5 forks source link

0 / 641 tests failed on v1.13.1 #72

Closed oomichi closed 5 years ago

oomichi commented 5 years ago

v1.13.1 における e2e 全テスト実行結果分析

oomichi commented 5 years ago

42 / 643 failed, 6.5%, 16h16m, 2018/12/28

[Fail] [k8s.io] [sig-node] Mount propagation [It] should propagate mounts to the host
[Fail] [sig-cli] Kubectl Port forwarding [k8s.io] With a server listening on localhost [k8s.io] that expects a client request [It] should support a client that connects, sends NO DATA, and disconnects
[Fail] [sig-instrumentation] MetricsGrabber [It] should grab all metrics from a ControllerManager.
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] provisioning [It] should provision storage with defaults
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should fail if non-existent subpath is outside the volume [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should fail if subpath directory is outside the volume [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should fail if subpath file is outside the volume [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should fail if subpath with backstepping is outside the volume [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support creating multiple subpath from same volumes [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support existing directories when readOnly specified in the volumeSource
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support existing directory
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support existing single file
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support file as subpath
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support non-existent path
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support readOnly directory specified in the volumeMount
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support readOnly file specified in the volumeMount
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support restarting containers using directory as subpath [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support restarting containers using file as subpath [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] volumeIO [BeforeEach] should write files of various sizes, verify size, validate content [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] volumes [BeforeEach] should allow exec of files on the volume
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (default fs)] volumes [BeforeEach] should be mountable
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode [It] should create sc, pod, pv, and pvc, read/write to the pv, and delete all created resources
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] provisioning [It] should provision storage with defaults
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should fail if non-existent subpath is outside the volume [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should fail if subpath directory is outside the volume [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should fail if subpath file is outside the volume [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should fail if subpath with backstepping is outside the volume [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support creating multiple subpath from same volumes [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support existing directories when readOnly specified in the volumeSource
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support existing directory
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support existing single file
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support file as subpath
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support non-existent path
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support readOnly directory specified in the volumeMount
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support readOnly file specified in the volumeMount
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support restarting containers using directory as subpath [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] subPath [BeforeEach] should support restarting containers using file as subpath [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] volumeIO [BeforeEach] should write files of various sizes, verify size, validate content [Slow]
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] volumes [BeforeEach] should allow exec of files on the volume
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (default fs)] volumes [BeforeEach] should be mountable
[Fail] [sig-storage] CSI Volumes [Driver: csi-hostpath-v0] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode [It] should create sc, pod, pv, and pvc, read/write to the pv, and delete all created resources
[Fail] [sig-storage] In-tree Volumes [Driver: nfs] [Testpattern: Pre-provisioned PV (default fs)] subPath [It] should support restarting containers using directory as subpath [Slow]
oomichi commented 5 years ago

https://github.com/oomichi/try-kubernetes/commit/2f8d2ee85fee55086c1fae685072fd5b8bec205d の実施し忘れ・・ 設定を行い、全テスト再実行中

oomichi commented 5 years ago

7 / 641 failed, 1.0%, 13h32m, 2019/01/08

[Fail] [sig-cli] Kubectl Port forwarding [k8s.io] With a server listening on 0.0.0.0 [k8s.io] that expects a client request [It] should support a client that connects, sends DATA, and disconnects
[Fail] [sig-cli] Kubectl Port forwarding [k8s.io] With a server listening on localhost [k8s.io] that expects a client request [It] should support a client that connects, sends DATA, and disconnects
[Fail] [sig-instrumentation] MetricsGrabber [It] should grab all metrics from a ControllerManager.
[Fail] [sig-storage] In-tree Volumes [Driver: nfs] [BeforeEach] [Testpattern: Dynamic PV (default fs)] provisioning should provision storage with defaults
[Fail] [sig-storage] In-tree Volumes [Driver: nfs] [BeforeEach] [Testpattern: Dynamic PV (default fs)] subPath should fail if subpath with backstepping is outside the volume [Slow]
[Fail] [sig-storage] In-tree Volumes [Driver: nfs] [BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath should fail if subpath file is outside the volume [Slow]
[Fail] [sig-storage] PersistentVolumes-local  [Volume type: dir-link] [BeforeEach] One pod requesting one prebound PVC should be able to mount volume and read from pod1
oomichi commented 5 years ago

MetricsGrabber は https://github.com/oomichi/try-kubernetes/commit/cde078592ea75f5145853dd059e330a7321e66bf で対応

oomichi commented 5 years ago

3 / 641 failed, 0.4%, 13h25m, 2019/01/09

[Fail] [sig-autoscaling] [HPA] Horizontal pod autoscaling (scale resource: CPU) [sig-autoscaling] [Serial] [Slow] ReplicationController [It] Should scale from 1 pod to 3 pods and from 3 to 5 and verify decision stability
[Fail] [sig-storage] PV Protection [BeforeEach] Verify "immediate" deletion of a PV that is not bound to a PVC
[Fail] [sig-storage] PV Protection [BeforeEach] Verify that PV bound to a PVC is not removed immediately

3つとも flake だ・・

oomichi commented 5 years ago

https://github.com/oomichi/try-kubernetes/issues/42 で再調査

oomichi commented 5 years ago

0 / 641 failed, 0.4%, 13h44m, 2019/02/26

Admission ControllerのStorageObjectInUseProtection Pluginを有効にすることで、テストが安定化