SovereignCloudStack / cluster-stacks

Definition of Cluster Stacks based on the ClusterAPI ClusterClass feature
https://scs.community/
Apache License 2.0
7 stars 6 forks source link

:sparkles: Add zuul e2e for openstack #53

Closed matofeder closed 2 months ago

matofeder commented 4 months ago

Closes https://github.com/SovereignCloudStack/cluster-stacks/issues/31

The cluster_stack you want to test with this e2e pipeline must be specified via zuul_config in the description of the PR, like it is done here, otherwise it will test openstack-alpha-1-29, which is currently as a default.

The Zuul pipeline cannot be triggered by the label until this PR is merged.

For more details, check this doc

cluster_stack = "openstack-alpha-1-30"
scs-zuul[bot] commented 2 months ago

Build canceled (e2e-quick-test pipeline).

michal-gubricky commented 2 months ago

Hi @jschoone, it should be possible now to trigger the pipeline by adding the label e2e-quick-test for e2e-openstack-quick tests or e2e-test for e2e-openstack-conformance tests like it is in k8s-cluster-api-provider repo.

jschoone commented 2 months ago

Hi @jschoone, it should be possible now to trigger the pipeline by adding the label e2e-quick-test for e2e-openstack-quick tests or e2e-test for e2e-openstack-conformance tests like it is in k8s-cluster-api-provider repo.

Thanks @michal-gubricky, will try it tomorrow :)

scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/46f4121ef60c437f9c79e226c5c4f0c3

:x: e2e-openstack-quick FAILURE in 10m 06s

scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/09635b26ad744a23976c2e1ea917302c

:x: e2e-openstack-quick FAILURE in 22m 31s

scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/e3fd00d93be042cd91da30828817c597

:x: e2e-openstack-quick RETRY_LIMIT in 12m 05s

michal-gubricky commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/e3fd00d93be042cd91da30828817c597

e2e-openstack-quick RETRY_LIMIT in 12m 05s

Failed during building a csctl, problem is the last commit in this repository. Take a look at https://github.com/SovereignCloudStack/csctl/actions/runs/9205776982/job/25322184680

scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/dff267a37d094645a03daa2459272c09

:x: e2e-openstack-quick FAILURE in 18m 35s

scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/429f228537224c1086e165363ac32658

:x: e2e-openstack-quick FAILURE in 30m 26s

michal-gubricky commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/429f228537224c1086e165363ac32658

e2e-openstack-quick FAILURE in 30m 26s

Failed during sonobuoy tests with error: failed to get namespace sonobuoy: etcdserver: request timed out and etcdserver: leader changed, check logs.

scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/e432bfc2e63c443eb20be0d93611a197

:x: e2e-openstack-quick FAILURE in 21m 19s

scs-zuul[bot] commented 2 months ago

Build succeeded (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/2107ac4c1c684914a2f9927ff5ed926f

:heavy_check_mark: e2e-openstack-quick SUCCESS in 30m 05s

Warning:

SCS Compliance results Testing SCS Compatible KaaS version v2 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... INFO: Checking cluster specified by default context in /home/ubuntu/cluster_manifest/kubeconfig-test-cluster. INFO: The K8s cluster version 1.29.5 of cluster 'test-cluster-admin@test-cluster' is still in the recency time window. ... returned 0 errors, 0 aborts ******************************************************* Testing standard Kubernetes node distribution and availability ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0214-v1-k8s-node-distribution.md ... WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes. WARNING: There seems to be no distribution across multiple zones or labels aren't set correctly across nodes. INFO: The nodes are distributed across 2 host-ids. WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes. WARNING: There seems to be no distribution across multiple zones or labels aren't set correctly across nodes. INFO: The nodes are distributed across 3 host-ids. The config file under ./config.yaml couldn't be found, falling back to the default config. ... returned 0 errors, 0 aborts ******************************************************* Testing standard CNCF Kubernetes conformance ... Reference: https://github.com/cncf/k8s-conformance/tree/master ... WARNING: No check tool specified for CNCF Kubernetes conformance ******************************************************* Verdict for subject KaaS_V2, SCS Compatible KaaS, version v2: PASSED Testing SCS Compatible KaaS version v1 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... ... returned 0 errors, 0 aborts ******************************************************* Testing standard Kubernetes node distribution and availability ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0214-v1-k8s-node-distribution.md ... ... returned 0 errors, 0 aborts ******************************************************* Verdict for subject KaaS_V2, SCS Compatible KaaS, version v1: PASSED
Sonobouy results Plugin: e2e Status: passed Total: 7412 Passed: 5 Failed: 0 Skipped: 7407 Plugin: systemd-logs Status: passed Total: 2 Passed: 2 Failed: 0 Skipped: 0 Run Details: API Server version: v1.29.5 Node health: 5/5 (100%) Pods health: 38/38 (100%) Errors detected in files: Warnings: 907 podlogs/kube-system/etcd-test-cluster-ml5gl-nc5gp/logs/etcd.txt 457 podlogs/kube-system/etcd-test-cluster-ml5gl-c77wk/logs/etcd.txt 52 podlogs/kube-system/kube-apiserver-test-cluster-ml5gl-nc5gp/logs/kube-apiserver.txt 31 podlogs/kube-system/kube-apiserver-test-cluster-ml5gl-c77wk/logs/kube-apiserver.txt 16 podlogs/kube-system/openstack-cinder-csi-controllerplugin-7d6c8cf9c-tbzdg/logs/csi-snapshotter.txt 7 podlogs/kube-system/cilium-nzbsb/logs/cilium-agent.txt 4 podlogs/kube-system/openstack-cloud-controller-manager-hsnzb/logs/openstack-cloud-controller-manager.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-4d5tw/logs/liveness-probe.txt 2 podlogs/kube-system/kube-controller-manager-test-cluster-ml5gl-nc5gp/logs/kube-controller-manager.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-8rhct/logs/liveness-probe.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-w8x6w/logs/liveness-probe.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-cmws2/logs/node-driver-registrar.txt 2 podlogs/kube-system/openstack-cinder-csi-controllerplugin-7d6c8cf9c-tbzdg/logs/csi-provisioner.txt 2 podlogs/kube-system/cilium-operator-7c795f5c7d-kf2cx/logs/cilium-operator.txt 1 podlogs/sonobuoy/sonobuoy/logs/kube-sonobuoy.txt 1 podlogs/kube-system/openstack-cloud-controller-manager-zfw88/logs/openstack-cloud-controller-manager.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-4d5tw/logs/node-driver-registrar.txt 1 podlogs/kube-system/cilium-gh64t/logs/cilium-agent.txt 1 podlogs/sonobuoy/sonobuoy-e2e-job-f3b18154bc9240ea/logs/e2e.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-t68q7/logs/node-driver-registrar.txt 1 podlogs/kube-system/cilium-mm8vp/logs/cilium-agent.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-cmws2/logs/liveness-probe.txt 1 podlogs/kube-system/cilium-g65d7/logs/cilium-agent.txt Errors: 156 podlogs/kube-system/kube-apiserver-test-cluster-ml5gl-nc5gp/logs/kube-apiserver.txt 74 podlogs/kube-system/etcd-test-cluster-ml5gl-nc5gp/logs/etcd.txt 32 podlogs/kube-system/openstack-cinder-csi-controllerplugin-7d6c8cf9c-tbzdg/logs/csi-snapshotter.txt 20 podlogs/kube-system/etcd-test-cluster-ml5gl-c77wk/logs/etcd.txt 6 podlogs/kube-system/kube-proxy-6pv4h/logs/kube-proxy.txt 6 podlogs/kube-system/cilium-operator-7c795f5c7d-kf2cx/logs/cilium-operator.txt 6 podlogs/kube-system/cilium-nzbsb/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-g65d7/logs/cilium-agent.txt 5 podlogs/kube-system/kube-controller-manager-test-cluster-ml5gl-nc5gp/logs/kube-controller-manager.txt 5 podlogs/kube-system/cilium-mm8vp/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-gh64t/logs/cilium-agent.txt 4 podlogs/kube-system/kube-controller-manager-test-cluster-ml5gl-c77wk/logs/kube-controller-manager.txt 4 podlogs/kube-system/cilium-k5tdt/logs/cilium-agent.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-w8x6w/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-t68q7/logs/node-driver-registrar.txt 1 podlogs/sonobuoy/sonobuoy-e2e-job-f3b18154bc9240ea/logs/e2e.txt 1 podlogs/kube-system/metrics-server-666c6745d5-nszsm/logs/metrics-server.txt 1 podlogs/kube-system/openstack-cloud-controller-manager-hsnzb/logs/openstack-cloud-controller-manager.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-cmws2/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-8rhct/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-4d5tw/logs/node-driver-registrar.txt
jschoone commented 2 months ago

Hi @michal-gubricky, can the playbooks dir moved into .zuul to ensure the context in which they are placed?

michal-gubricky commented 2 months ago

Hi @michal-gubricky, can the playbooks dir moved into .zuul to ensure the context in which they are placed?

Hi, I think it is a common pattern to have .zuul.yaml in a <project-root> and also have the playbooks dir there, where are placed ansible playbooks/tasks which are used in zuul pipeline. For example, we use this structure in k8s-cluster-api-provider also other organizations use this structure like OSISM. But surely we can discuss it more here.

jschoone commented 2 months ago

Hi @michal-gubricky, can the playbooks dir moved into .zuul to ensure the context in which they are placed?

Hi, I think it is a common pattern to have .zuul.yaml in a <project-root> and also have the playbooks dir there, where are placed ansible playbooks/tasks which are used in zuul pipeline. For example, we use this structure in k8s-cluster-api-provider also other organizations use this structure like OSISM. But surely we can discuss it more here.

I see, thanks for checking

scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/a9920c1654fb4cd5bef434333563e03a

:x: e2e-openstack-quick FAILURE in 17m 53s

scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/4176272e3cf34c23a407681c256522fd

:x: e2e-openstack-quick FAILURE in 21m 50s

scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/3d0d701a0c854170bdb182801c3d8334

:x: e2e-openstack-quick FAILURE in 17m 42s

scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/e204643f706249629b171a75e61a39c6

:x: e2e-openstack-quick FAILURE in 35m 19s

Warning:

SCS Compliance results Testing SCS Compatible KaaS version v2 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... INFO: Checking cluster specified by default context in /home/ubuntu/cluster_manifest/kubeconfig-test-cluster. ERROR: The K8s cluster version 1.30.1 of cluster 'test-cluster-admin@test-cluster' is already EOL. ... returned 1 errors, 0 aborts ******************************************************* Testing standard Kubernetes node distribution and availability ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0214-v1-k8s-node-distribution.md ... WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes. WARNING: There seems to be no distribution across multiple zones or labels aren't set correctly across nodes. INFO: The nodes are distributed across 3 host-ids. WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes. WARNING: There seems to be no distribution across multiple zones or labels aren't set correctly across nodes. INFO: The nodes are distributed across 2 host-ids. The config file under ./config.yaml couldn't be found, falling back to the default config. ... returned 0 errors, 0 aborts ******************************************************* Testing standard CNCF Kubernetes conformance ... Reference: https://github.com/cncf/k8s-conformance/tree/master ... WARNING: No check tool specified for CNCF Kubernetes conformance ******************************************************* Verdict for subject KaaS_V2, SCS Compatible KaaS, version v2: 1 ERRORS Testing SCS Compatible KaaS version v1 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... ... returned 1 errors, 0 aborts ******************************************************* Testing standard Kubernetes node distribution and availability ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0214-v1-k8s-node-distribution.md ... ... returned 0 errors, 0 aborts ******************************************************* Verdict for subject KaaS_V2, SCS Compatible KaaS, version v1: 1 ERRORS
Sonobouy results Plugin: e2e Status: passed Total: 7201 Passed: 5 Failed: 0 Skipped: 7196 Plugin: systemd-logs Status: passed Total: 5 Passed: 5 Failed: 0 Skipped: 0 Run Details: API Server version: v1.30.1 Node health: 6/6 (100%) Pods health: 47/47 (100%) Errors detected in files: Errors: 147 podlogs/kube-system/kube-apiserver-test-cluster-kmrdd-z2tfn/logs/kube-apiserver.txt 59 podlogs/kube-system/kube-apiserver-test-cluster-kmrdd-qqzwg/logs/kube-apiserver.txt 56 podlogs/kube-system/etcd-test-cluster-kmrdd-z2tfn/logs/etcd.txt 40 podlogs/kube-system/openstack-cinder-csi-controllerplugin-8487ccd846-phng6/logs/csi-snapshotter.txt 33 podlogs/kube-system/kube-scheduler-test-cluster-kmrdd-qqzwg/logs/kube-scheduler.txt 32 podlogs/kube-system/etcd-test-cluster-kmrdd-qqzwg/logs/etcd.txt 21 podlogs/kube-system/kube-apiserver-test-cluster-kmrdd-trx9f/logs/kube-apiserver.txt 20 podlogs/kube-system/kube-controller-manager-test-cluster-kmrdd-qqzwg/logs/kube-controller-manager.txt 6 podlogs/kube-system/cilium-s982j/logs/cilium-agent.txt 6 podlogs/kube-system/cilium-w9b2j/logs/cilium-agent.txt 6 podlogs/kube-system/cilium-d6mw6/logs/cilium-agent.txt 6 podlogs/kube-system/kube-proxy-5hs6f/logs/kube-proxy.txt 5 podlogs/kube-system/cilium-zcsd6/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-rzfk8/logs/cilium-agent.txt 4 podlogs/kube-system/cilium-jt4gv/logs/cilium-agent.txt 4 podlogs/kube-system/cilium-operator-7c98cbbbf9-4nrsv/logs/cilium-operator.txt 3 podlogs/kube-system/etcd-test-cluster-kmrdd-trx9f/logs/etcd.txt 2 podlogs/kube-system/kube-controller-manager-test-cluster-kmrdd-trx9f/logs/kube-controller-manager.txt 1 podlogs/kube-system/kube-scheduler-test-cluster-kmrdd-trx9f/logs/kube-scheduler.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-xw4kv/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-8lb82/logs/node-driver-registrar.txt 1 podlogs/sonobuoy/sonobuoy-e2e-job-8dda8042d8d64e16/logs/e2e.txt 1 podlogs/kube-system/openstack-cloud-controller-manager-hwgd5/logs/openstack-cloud-controller-manager.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-sb2j2/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-t5zsj/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-mswnl/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-7ngt8/logs/node-driver-registrar.txt Warnings: 1268 podlogs/kube-system/etcd-test-cluster-kmrdd-z2tfn/logs/etcd.txt 486 podlogs/kube-system/etcd-test-cluster-kmrdd-qqzwg/logs/etcd.txt 112 podlogs/kube-system/etcd-test-cluster-kmrdd-trx9f/logs/etcd.txt 59 podlogs/kube-system/kube-apiserver-test-cluster-kmrdd-z2tfn/logs/kube-apiserver.txt 39 podlogs/kube-system/kube-apiserver-test-cluster-kmrdd-qqzwg/logs/kube-apiserver.txt 31 podlogs/kube-system/kube-apiserver-test-cluster-kmrdd-trx9f/logs/kube-apiserver.txt 20 podlogs/kube-system/openstack-cinder-csi-controllerplugin-8487ccd846-phng6/logs/csi-snapshotter.txt 18 podlogs/kube-system/kube-scheduler-test-cluster-kmrdd-qqzwg/logs/kube-scheduler.txt 6 podlogs/kube-system/cilium-zcsd6/logs/cilium-agent.txt 4 podlogs/kube-system/openstack-cloud-controller-manager-hwgd5/logs/openstack-cloud-controller-manager.txt 3 podlogs/kube-system/kube-scheduler-test-cluster-kmrdd-trx9f/logs/kube-scheduler.txt 3 podlogs/kube-system/kube-controller-manager-test-cluster-kmrdd-qqzwg/logs/kube-controller-manager.txt 2 podlogs/kube-system/cilium-d6mw6/logs/cilium-agent.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-mswnl/logs/node-driver-registrar.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-7ngt8/logs/node-driver-registrar.txt 2 podlogs/kube-system/cilium-s982j/logs/cilium-agent.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-t5zsj/logs/liveness-probe.txt 2 podlogs/kube-system/openstack-cinder-csi-controllerplugin-8487ccd846-phng6/logs/csi-attacher.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-8lb82/logs/liveness-probe.txt 2 podlogs/kube-system/cilium-w9b2j/logs/cilium-agent.txt 2 podlogs/kube-system/cilium-operator-7c98cbbbf9-4nrsv/logs/cilium-operator.txt 1 podlogs/kube-system/openstack-cloud-controller-manager-4nsc8/logs/openstack-cloud-controller-manager.txt 1 podlogs/kube-system/openstack-cinder-csi-controllerplugin-8487ccd846-phng6/logs/csi-provisioner.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-sb2j2/logs/liveness-probe.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-sb2j2/logs/node-driver-registrar.txt 1 podlogs/sonobuoy/sonobuoy/logs/kube-sonobuoy.txt 1 podlogs/kube-system/openstack-cloud-controller-manager-5nmsv/logs/openstack-cloud-controller-manager.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-t5zsj/logs/node-driver-registrar.txt 1 podlogs/sonobuoy/sonobuoy-e2e-job-8dda8042d8d64e16/logs/e2e.txt 1 podlogs/kube-system/cilium-rzfk8/logs/cilium-agent.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-7ngt8/logs/liveness-probe.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-mswnl/logs/liveness-probe.txt
scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/4263beb456634b00a1c6128383a54e0a

:x: e2e-openstack-quick FAILURE in 21m 12s

scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/2e2fad872bc34eda8c12f0115dd86bd0

:x: e2e-openstack-quick FAILURE in 31m 53s

Warning:

SCS Compliance results Testing SCS Compatible KaaS version v2 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... INFO: Checking cluster specified by default context in /home/ubuntu/cluster_manifest/kubeconfig-test-cluster. ERROR: The K8s cluster version 1.30.1 of cluster 'test-cluster-admin@test-cluster' is already EOL. ... returned 1 errors, 0 aborts ******************************************************* Testing standard Kubernetes node distribution and availability ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0214-v1-k8s-node-distribution.md ... WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes. WARNING: There seems to be no distribution across multiple zones or labels aren't set correctly across nodes. INFO: The nodes are distributed across 2 host-ids. WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes. WARNING: There seems to be no distribution across multiple zones or labels aren't set correctly across nodes. INFO: The nodes are distributed across 2 host-ids. The config file under ./config.yaml couldn't be found, falling back to the default config. ... returned 0 errors, 0 aborts ******************************************************* Testing standard CNCF Kubernetes conformance ... Reference: https://github.com/cncf/k8s-conformance/tree/master ... WARNING: No check tool specified for CNCF Kubernetes conformance ******************************************************* Verdict for subject KaaS_V2, SCS Compatible KaaS, version v2: 1 ERRORS Testing SCS Compatible KaaS version v1 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... ... returned 1 errors, 0 aborts ******************************************************* Testing standard Kubernetes node distribution and availability ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0214-v1-k8s-node-distribution.md ... ... returned 0 errors, 0 aborts ******************************************************* Verdict for subject KaaS_V2, SCS Compatible KaaS, version v1: 1 ERRORS
Sonobouy results Plugin: e2e Status: passed Total: 7201 Passed: 5 Failed: 0 Skipped: 7196 Plugin: systemd-logs Status: passed Total: 5 Passed: 5 Failed: 0 Skipped: 0 Run Details: API Server version: v1.30.1 Node health: 5/5 (100%) Pods health: 38/38 (100%) Errors detected in files: Errors: 133 podlogs/kube-system/kube-apiserver-test-cluster-nz4fl-btngl/logs/kube-apiserver.txt 59 podlogs/kube-system/etcd-test-cluster-nz4fl-btngl/logs/etcd.txt 39 podlogs/kube-system/etcd-test-cluster-nz4fl-47xgv/logs/etcd.txt 37 podlogs/kube-system/kube-apiserver-test-cluster-nz4fl-47xgv/logs/kube-apiserver.txt 33 podlogs/kube-system/kube-scheduler-test-cluster-nz4fl-47xgv/logs/kube-scheduler.txt 28 podlogs/kube-system/openstack-cinder-csi-controllerplugin-8487ccd846-nq52r/logs/csi-snapshotter.txt 9 podlogs/kube-system/kube-controller-manager-test-cluster-nz4fl-47xgv/logs/kube-controller-manager.txt 6 podlogs/kube-system/cilium-mbrtm/logs/cilium-agent.txt 6 podlogs/kube-system/kube-proxy-sd5qx/logs/kube-proxy.txt 6 podlogs/kube-system/cilium-lw8gj/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-lg7q5/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-5px62/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-operator-7c98cbbbf9-qq8ch/logs/cilium-operator.txt 5 podlogs/kube-system/cilium-2k2d6/logs/cilium-agent.txt 2 podlogs/kube-system/metrics-server-6766977797-xlvf6/logs/metrics-server.txt 1 podlogs/sonobuoy/sonobuoy-e2e-job-873987839dc14f47/logs/e2e.txt 1 podlogs/kube-system/openstack-cloud-controller-manager-vg4k2/logs/openstack-cloud-controller-manager.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-xdz6m/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-54tmk/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-dph2k/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-bfdfv/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-88gk6/logs/node-driver-registrar.txt Warnings: 691 podlogs/kube-system/etcd-test-cluster-nz4fl-btngl/logs/etcd.txt 492 podlogs/kube-system/etcd-test-cluster-nz4fl-47xgv/logs/etcd.txt 40 podlogs/kube-system/kube-apiserver-test-cluster-nz4fl-btngl/logs/kube-apiserver.txt 36 podlogs/kube-system/kube-apiserver-test-cluster-nz4fl-47xgv/logs/kube-apiserver.txt 19 podlogs/kube-system/kube-scheduler-test-cluster-nz4fl-47xgv/logs/kube-scheduler.txt 15 podlogs/kube-system/openstack-cinder-csi-controllerplugin-8487ccd846-nq52r/logs/csi-snapshotter.txt 6 podlogs/kube-system/cilium-2k2d6/logs/cilium-agent.txt 5 podlogs/sonobuoy/sonobuoy/logs/kube-sonobuoy.txt 4 podlogs/kube-system/openstack-cloud-controller-manager-vg4k2/logs/openstack-cloud-controller-manager.txt 3 podlogs/kube-system/openstack-cinder-csi-controllerplugin-8487ccd846-nq52r/logs/csi-provisioner.txt 2 podlogs/kube-system/cilium-lw8gj/logs/cilium-agent.txt 2 podlogs/kube-system/kube-controller-manager-test-cluster-nz4fl-47xgv/logs/kube-controller-manager.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-xdz6m/logs/liveness-probe.txt 2 podlogs/kube-system/cilium-mbrtm/logs/cilium-agent.txt 1 podlogs/kube-system/openstack-cloud-controller-manager-jpzx7/logs/openstack-cloud-controller-manager.txt 1 podlogs/kube-system/cilium-operator-7c98cbbbf9-qq8ch/logs/cilium-operator.txt 1 podlogs/sonobuoy/sonobuoy-e2e-job-873987839dc14f47/logs/e2e.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-54tmk/logs/liveness-probe.txt 1 podlogs/kube-system/cilium-5px62/logs/cilium-agent.txt 1 podlogs/kube-system/cilium-lg7q5/logs/cilium-agent.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-bfdfv/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-88gk6/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-88gk6/logs/liveness-probe.txt
scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/5768cfb441a648678dcd0fe2cfe6914d

:x: e2e-openstack-quick FAILURE in 37m 02s

Warning:

SCS Compliance results Testing SCS Compatible KaaS version v2 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... INFO: Checking cluster specified by default context in /home/ubuntu/cluster_manifest/kubeconfig-test-cluster. ERROR: The K8s cluster version 1.30.1 of cluster 'test-cluster-admin@test-cluster' is already EOL. ... returned 1 errors, 0 aborts ******************************************************* Testing standard Kubernetes node distribution and availability ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0214-v1-k8s-node-distribution.md ... WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes. WARNING: There seems to be no distribution across multiple zones or labels aren't set correctly across nodes. INFO: The nodes are distributed across 3 host-ids. WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes. WARNING: There seems to be no distribution across multiple zones or labels aren't set correctly across nodes. INFO: The nodes are distributed across 2 host-ids. The config file under ./config.yaml couldn't be found, falling back to the default config. ... returned 0 errors, 0 aborts ******************************************************* Testing standard CNCF Kubernetes conformance ... Reference: https://github.com/cncf/k8s-conformance/tree/master ... WARNING: No check tool specified for CNCF Kubernetes conformance ******************************************************* Verdict for subject KaaS_V2, SCS Compatible KaaS, version v2: 1 ERRORS Testing SCS Compatible KaaS version v1 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... ... returned 1 errors, 0 aborts ******************************************************* Testing standard Kubernetes node distribution and availability ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0214-v1-k8s-node-distribution.md ... ... returned 0 errors, 0 aborts ******************************************************* Verdict for subject KaaS_V2, SCS Compatible KaaS, version v1: 1 ERRORS
Sonobouy results Plugin: e2e Status: passed Total: 7201 Passed: 5 Failed: 0 Skipped: 7196 Plugin: systemd-logs Status: passed Total: 5 Passed: 5 Failed: 0 Skipped: 0 Run Details: API Server version: v1.30.1 Node health: 5/6 (83%) Details for failed nodes: test-cluster-nx6dn-j5msh Ready:False: KubeletNotReady: [container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful, container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: cni plugin not initialized, CSINode is not yet initialized] Pods health: 41/46 (89%) Details for failed pods: kube-system/cilium-zr9lt Ready:False: : kube-system/kube-controller-manager-test-cluster-nx6dn-j5msh Ready:: : kube-system/kube-scheduler-test-cluster-nx6dn-j5msh Ready:: : kube-system/openstack-cinder-csi-nodeplugin-qzlht Ready:False: : sonobuoy/sonobuoy-systemd-logs-daemon-set-dac6efc61adc49ac-b5lhx Ready:False: : Errors detected in files: Warnings: 6 podlogs/kube-system/cilium-dbcc8/logs/cilium-agent.txt 2 podlogs/kube-system/cilium-kvmff/logs/cilium-agent.txt 2 podlogs/kube-system/cilium-ndwhx/logs/cilium-agent.txt 2 podlogs/kube-system/cilium-5gkm9/logs/cilium-agent.txt 1 podlogs/kube-system/cilium-operator-7c98cbbbf9-pp6zh/logs/cilium-operator.txt 1 podlogs/kube-system/cilium-r8rd5/logs/cilium-agent.txt 1 podlogs/sonobuoy/sonobuoy-e2e-job-58f597a5cd16429e/logs/e2e.txt 1 podlogs/sonobuoy/sonobuoy/logs/kube-sonobuoy.txt Errors: 6 podlogs/kube-system/cilium-ndwhx/logs/cilium-agent.txt 6 podlogs/kube-system/cilium-5gkm9/logs/cilium-agent.txt 6 podlogs/kube-system/cilium-kvmff/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-r8rd5/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-dbcc8/logs/cilium-agent.txt 3 podlogs/kube-system/cilium-operator-7c98cbbbf9-pp6zh/logs/cilium-operator.txt 1 podlogs/sonobuoy/sonobuoy-e2e-job-58f597a5cd16429e/logs/e2e.txt 1 podlogs/sonobuoy/sonobuoy/logs/kube-sonobuoy.txt
scs-zuul[bot] commented 2 months ago

Build canceled (e2e-quick-test pipeline).

scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/d5e1188c39114699abb88c56ccd19718

:x: e2e-openstack-quick FAILURE in 41m 40s

Warning:

SCS Compliance results Testing SCS Compatible KaaS version v2 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... INFO: Checking cluster specified by default context in /home/ubuntu/cluster_manifest/kubeconfig-test-cluster. ERROR: The K8s cluster version 1.30.1 of cluster 'test-cluster-admin@test-cluster' is already EOL. ... returned 1 errors, 0 aborts ******************************************************* Testing standard Kubernetes node distribution and availability ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0214-v1-k8s-node-distribution.md ... WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes. WARNING: There seems to be no distribution across multiple zones or labels aren't set correctly across nodes. INFO: The nodes are distributed across 3 host-ids. WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes. WARNING: There seems to be no distribution across multiple zones or labels aren't set correctly across nodes. INFO: The nodes are distributed across 3 host-ids. The config file under ./config.yaml couldn't be found, falling back to the default config. ... returned 0 errors, 0 aborts ******************************************************* Testing standard CNCF Kubernetes conformance ... Reference: https://github.com/cncf/k8s-conformance/tree/master ... WARNING: No check tool specified for CNCF Kubernetes conformance ******************************************************* Verdict for subject KaaS_V2, SCS Compatible KaaS, version v2: 1 ERRORS Testing SCS Compatible KaaS version v1 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... ... returned 1 errors, 0 aborts ******************************************************* Testing standard Kubernetes node distribution and availability ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0214-v1-k8s-node-distribution.md ... ... returned 0 errors, 0 aborts ******************************************************* Verdict for subject KaaS_V2, SCS Compatible KaaS, version v1: 1 ERRORS
Sonobouy results Plugin: e2e Status: passed Total: 7201 Passed: 5 Failed: 0 Skipped: 7196 Plugin: systemd-logs Status: passed Total: 5 Passed: 5 Failed: 0 Skipped: 0 Run Details: API Server version: v1.30.1 Node health: 6/6 (100%) Pods health: 47/47 (100%) Errors detected in files: Errors: 147 podlogs/kube-system/kube-scheduler-test-cluster-xnqjp-st7hk/logs/kube-scheduler.txt 106 podlogs/kube-system/kube-apiserver-test-cluster-xnqjp-wljs5/logs/kube-apiserver.txt 71 podlogs/kube-system/etcd-test-cluster-xnqjp-wljs5/logs/etcd.txt 61 podlogs/kube-system/kube-scheduler-test-cluster-xnqjp-wljs5/logs/kube-scheduler.txt 56 podlogs/kube-system/openstack-cinder-csi-controllerplugin-8487ccd846-9tnql/logs/csi-snapshotter.txt 54 podlogs/kube-system/kube-apiserver-test-cluster-xnqjp-xxrkc/logs/kube-apiserver.txt 34 podlogs/kube-system/etcd-test-cluster-xnqjp-st7hk/logs/etcd.txt 33 podlogs/kube-system/kube-apiserver-test-cluster-xnqjp-st7hk/logs/kube-apiserver.txt 26 podlogs/kube-system/kube-controller-manager-test-cluster-xnqjp-wljs5/logs/kube-controller-manager.txt 12 podlogs/kube-system/etcd-test-cluster-xnqjp-xxrkc/logs/etcd.txt 8 podlogs/kube-system/kube-controller-manager-test-cluster-xnqjp-st7hk/logs/kube-controller-manager.txt 7 podlogs/kube-system/metrics-server-6766977797-8rst5/logs/metrics-server.txt 7 podlogs/kube-system/cilium-operator-7c98cbbbf9-ggvt7/logs/cilium-operator.txt 6 podlogs/sonobuoy/sonobuoy-systemd-logs-daemon-set-3e2f1dfc05c74579-2c9l9/logs/sonobuoy-worker.txt 6 podlogs/kube-system/kube-proxy-7bfk7/logs/kube-proxy.txt 5 podlogs/kube-system/cilium-572th/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-5x7dp/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-5b7v2/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-w9q5t/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-cptt4/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-fgtrz/logs/cilium-agent.txt 3 podlogs/kube-system/kube-controller-manager-test-cluster-xnqjp-xxrkc/logs/kube-controller-manager.txt 2 podlogs/sonobuoy/sonobuoy/logs/kube-sonobuoy.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-kj6xf/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-7skjt/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-d4n6z/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-dtdzw/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-kcfqp/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cloud-controller-manager-t6dr2/logs/openstack-cloud-controller-manager.txt 1 podlogs/kube-system/cilium-operator-7c98cbbbf9-qdsgs/logs/cilium-operator.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-tgpfw/logs/node-driver-registrar.txt 1 podlogs/kube-system/kube-scheduler-test-cluster-xnqjp-xxrkc/logs/kube-scheduler.txt 1 podlogs/sonobuoy/sonobuoy-e2e-job-ca069369cea944ff/logs/e2e.txt Warnings: 859 podlogs/kube-system/etcd-test-cluster-xnqjp-wljs5/logs/etcd.txt 632 podlogs/kube-system/etcd-test-cluster-xnqjp-xxrkc/logs/etcd.txt 406 podlogs/kube-system/etcd-test-cluster-xnqjp-st7hk/logs/etcd.txt 69 podlogs/kube-system/kube-scheduler-test-cluster-xnqjp-st7hk/logs/kube-scheduler.txt 66 podlogs/kube-system/kube-apiserver-test-cluster-xnqjp-wljs5/logs/kube-apiserver.txt 52 podlogs/kube-system/kube-apiserver-test-cluster-xnqjp-xxrkc/logs/kube-apiserver.txt 34 podlogs/kube-system/kube-scheduler-test-cluster-xnqjp-wljs5/logs/kube-scheduler.txt 32 podlogs/kube-system/kube-apiserver-test-cluster-xnqjp-st7hk/logs/kube-apiserver.txt 28 podlogs/kube-system/openstack-cinder-csi-controllerplugin-8487ccd846-9tnql/logs/csi-snapshotter.txt 6 podlogs/kube-system/cilium-5x7dp/logs/cilium-agent.txt 4 podlogs/kube-system/openstack-cloud-controller-manager-t6dr2/logs/openstack-cloud-controller-manager.txt 3 podlogs/kube-system/kube-scheduler-test-cluster-xnqjp-xxrkc/logs/kube-scheduler.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-d4n6z/logs/liveness-probe.txt 2 podlogs/kube-system/kube-controller-manager-test-cluster-xnqjp-wljs5/logs/kube-controller-manager.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-kcfqp/logs/node-driver-registrar.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-kj6xf/logs/node-driver-registrar.txt 1 podlogs/kube-system/cilium-572th/logs/cilium-agent.txt 1 podlogs/kube-system/openstack-cloud-controller-manager-5lh85/logs/openstack-cloud-controller-manager.txt 1 podlogs/kube-system/cilium-operator-7c98cbbbf9-qdsgs/logs/cilium-operator.txt 1 podlogs/sonobuoy/sonobuoy-systemd-logs-daemon-set-3e2f1dfc05c74579-2c9l9/logs/sonobuoy-worker.txt 1 podlogs/kube-system/cilium-w9q5t/logs/cilium-agent.txt 1 podlogs/kube-system/cilium-5b7v2/logs/cilium-agent.txt 1 podlogs/sonobuoy/sonobuoy-e2e-job-ca069369cea944ff/logs/e2e.txt 1 podlogs/kube-system/openstack-cinder-csi-controllerplugin-8487ccd846-9tnql/logs/csi-provisioner.txt 1 podlogs/kube-system/openstack-cloud-controller-manager-r2jjr/logs/openstack-cloud-controller-manager.txt 1 podlogs/kube-system/cilium-cptt4/logs/cilium-agent.txt 1 podlogs/kube-system/cilium-fgtrz/logs/cilium-agent.txt 1 podlogs/sonobuoy/sonobuoy/logs/kube-sonobuoy.txt 1 podlogs/kube-system/cilium-operator-7c98cbbbf9-ggvt7/logs/cilium-operator.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-dtdzw/logs/liveness-probe.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-d4n6z/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-kcfqp/logs/liveness-probe.txt
scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/9f4c798e9d6f4b658e1586732a75f3d6

:x: e2e-openstack-quick FAILURE in 18m 34s

scs-zuul[bot] commented 2 months ago

Build failed (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/034bc20af19e42abb1f5be6611f39373

:x: e2e-openstack-quick FAILURE in 22m 36s

scs-zuul[bot] commented 2 months ago

Build canceled (e2e-quick-test pipeline).

scs-zuul[bot] commented 2 months ago

Build canceled (e2e-quick-test pipeline).

scs-zuul[bot] commented 2 months ago

Build succeeded (e2e-quick-test pipeline). https://zuul.scs.community/t/SCS/buildset/9b1cd326c0f54257abaee4fd09b68e14

:heavy_check_mark: e2e-openstack-quick SUCCESS in 38m 39s

Warning:

SCS Compliance results Testing SCS Compatible KaaS version v2 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... INFO: Checking cluster specified by default context in /home/ubuntu/cluster_manifest/kubeconfig-test-cluster. INFO: The K8s cluster version 1.30.1 of cluster 'test-cluster-admin@test-cluster' is still in the recency time window. ... returned 0 errors, 0 aborts ******************************************************* Testing standard Kubernetes node distribution and availability ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0214-v1-k8s-node-distribution.md ... WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes. WARNING: There seems to be no distribution across multiple zones or labels aren't set correctly across nodes. INFO: The nodes are distributed across 3 host-ids. WARNING: There seems to be no distribution across multiple regions or labels aren't set correctly across nodes. WARNING: There seems to be no distribution across multiple zones or labels aren't set correctly across nodes. INFO: The nodes are distributed across 2 host-ids. The config file under ./config.yaml couldn't be found, falling back to the default config. ... returned 0 errors, 0 aborts ******************************************************* Testing standard CNCF Kubernetes conformance ... Reference: https://github.com/cncf/k8s-conformance/tree/master ... WARNING: No check tool specified for CNCF Kubernetes conformance ******************************************************* Verdict for subject KaaS_V2, SCS Compatible KaaS, version v2: PASSED Testing SCS Compatible KaaS version v1 ******************************************************* Testing standard Kubernetes version policy ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0210-v2-k8s-version-policy.md ... ... returned 0 errors, 0 aborts ******************************************************* Testing standard Kubernetes node distribution and availability ... Reference: https://raw.githubusercontent.com/SovereignCloudStack/standards/main/Standards/scs-0214-v1-k8s-node-distribution.md ... ... returned 0 errors, 0 aborts ******************************************************* Verdict for subject KaaS_V2, SCS Compatible KaaS, version v1: PASSED
Sonobouy results Plugin: e2e Status: passed Total: 7201 Passed: 5 Failed: 0 Skipped: 7196 Plugin: systemd-logs Status: passed Total: 5 Passed: 5 Failed: 0 Skipped: 0 Run Details: API Server version: v1.30.1 Node health: 6/6 (100%) Pods health: 44/47 (93%) Details for failed pods: kube-system/openstack-cinder-csi-nodeplugin-j4q26 Ready:False: : kube-system/openstack-cloud-controller-manager-vw4zc Ready:False: : sonobuoy/sonobuoy-systemd-logs-daemon-set-f4f79cbd44fd4d45-x5fgh Ready:False: : Errors detected in files: Errors: 178 podlogs/kube-system/kube-scheduler-test-cluster-jq7qc-jk9mg/logs/kube-scheduler.txt 97 podlogs/kube-system/kube-apiserver-test-cluster-jq7qc-j5hnf/logs/kube-apiserver.txt 62 podlogs/kube-system/etcd-test-cluster-jq7qc-j5hnf/logs/etcd.txt 61 podlogs/kube-system/kube-scheduler-test-cluster-jq7qc-j5hnf/logs/kube-scheduler.txt 56 podlogs/kube-system/openstack-cinder-csi-controllerplugin-8487ccd846-jctlq/logs/csi-snapshotter.txt 49 podlogs/kube-system/kube-apiserver-test-cluster-jq7qc-v89vq/logs/kube-apiserver.txt 41 podlogs/kube-system/etcd-test-cluster-jq7qc-jk9mg/logs/etcd.txt 33 podlogs/kube-system/kube-scheduler-test-cluster-jq7qc-v89vq/logs/kube-scheduler.txt 27 podlogs/kube-system/kube-controller-manager-test-cluster-jq7qc-j5hnf/logs/kube-controller-manager.txt 24 podlogs/kube-system/kube-apiserver-test-cluster-jq7qc-jk9mg/logs/kube-apiserver.txt 16 podlogs/kube-system/etcd-test-cluster-jq7qc-v89vq/logs/etcd.txt 10 podlogs/kube-system/kube-controller-manager-test-cluster-jq7qc-jk9mg/logs/kube-controller-manager.txt 8 podlogs/kube-system/metrics-server-6766977797-24zmp/logs/metrics-server.txt 6 podlogs/kube-system/kube-proxy-6q42m/logs/kube-proxy.txt 5 podlogs/kube-system/cilium-4dsdz/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-bqjhj/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-lgdvb/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-kfshs/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-hmr4b/logs/cilium-agent.txt 5 podlogs/kube-system/cilium-hx2ms/logs/cilium-agent.txt 3 podlogs/kube-system/kube-controller-manager-test-cluster-jq7qc-v89vq/logs/kube-controller-manager.txt 2 podlogs/kube-system/cilium-operator-7c98cbbbf9-8v2sm/logs/cilium-operator.txt 1 podlogs/sonobuoy/sonobuoy/logs/kube-sonobuoy.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-fsprq/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-bzxvk/logs/node-driver-registrar.txt 1 podlogs/sonobuoy/sonobuoy-e2e-job-e6c5518b55fe4754/logs/e2e.txt 1 podlogs/kube-system/cilium-operator-7c98cbbbf9-gn98n/logs/cilium-operator.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-6m4q5/logs/node-driver-registrar.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-dgnkv/logs/node-driver-registrar.txt Warnings: 1106 podlogs/kube-system/etcd-test-cluster-jq7qc-j5hnf/logs/etcd.txt 646 podlogs/kube-system/etcd-test-cluster-jq7qc-v89vq/logs/etcd.txt 370 podlogs/kube-system/etcd-test-cluster-jq7qc-jk9mg/logs/etcd.txt 84 podlogs/kube-system/kube-scheduler-test-cluster-jq7qc-jk9mg/logs/kube-scheduler.txt 62 podlogs/kube-system/kube-apiserver-test-cluster-jq7qc-j5hnf/logs/kube-apiserver.txt 49 podlogs/kube-system/kube-apiserver-test-cluster-jq7qc-v89vq/logs/kube-apiserver.txt 34 podlogs/kube-system/kube-scheduler-test-cluster-jq7qc-j5hnf/logs/kube-scheduler.txt 32 podlogs/kube-system/kube-apiserver-test-cluster-jq7qc-jk9mg/logs/kube-apiserver.txt 28 podlogs/kube-system/openstack-cinder-csi-controllerplugin-8487ccd846-jctlq/logs/csi-snapshotter.txt 18 podlogs/kube-system/kube-scheduler-test-cluster-jq7qc-v89vq/logs/kube-scheduler.txt 6 podlogs/kube-system/cilium-lgdvb/logs/cilium-agent.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-6m4q5/logs/liveness-probe.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-dgnkv/logs/node-driver-registrar.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-dgnkv/logs/liveness-probe.txt 2 podlogs/kube-system/openstack-cinder-csi-nodeplugin-bzxvk/logs/liveness-probe.txt 2 podlogs/kube-system/kube-controller-manager-test-cluster-jq7qc-j5hnf/logs/kube-controller-manager.txt 2 podlogs/kube-system/openstack-cinder-csi-controllerplugin-8487ccd846-jctlq/logs/csi-provisioner.txt 1 podlogs/kube-system/cilium-hx2ms/logs/cilium-agent.txt 1 podlogs/sonobuoy/sonobuoy/logs/kube-sonobuoy.txt 1 podlogs/kube-system/cilium-bqjhj/logs/cilium-agent.txt 1 podlogs/kube-system/cilium-4dsdz/logs/cilium-agent.txt 1 podlogs/kube-system/cilium-operator-7c98cbbbf9-8v2sm/logs/cilium-operator.txt 1 podlogs/kube-system/cilium-operator-7c98cbbbf9-gn98n/logs/cilium-operator.txt 1 podlogs/kube-system/cilium-kfshs/logs/cilium-agent.txt 1 podlogs/sonobuoy/sonobuoy-e2e-job-e6c5518b55fe4754/logs/e2e.txt 1 podlogs/kube-system/openstack-cinder-csi-nodeplugin-6m4q5/logs/node-driver-registrar.txt 1 podlogs/kube-system/cilium-hmr4b/logs/cilium-agent.txt