search

canonical / k8s-snap

Canonical Kubernetes is an opinionated and CNCF conformant Kubernetes operated by Snaps and Charms, which come together to bring simplified operations and an enhanced security posture on any infrastructure.
GNU General Public License v3.0
43 stars 13 forks source link

Sonobuoy e2e nigthly tests #715

Open maci3jka opened 1 month ago

maci3jka commented 1 month ago

This pr introduces Sonobuoy end-to-end test for canonical Kubernetes.

bschimke95 commented 1 month ago

Please add the pull_request tag to the workflow, so that we can see that the test actually runs and passes (to be removed before merging).

maci3jka commented 1 month ago

Please add the pull_request tag to the workflow, so that we can see that the test actually runs and passes (to be removed before merging). here's build https://github.com/canonical/k8s-snap/actions/runs/11218620215/job/31182795421?pr=715

bschimke95 commented 1 month ago

I see that the test is marked as succeeded but the sonobouy test failed:

17:00:17       e2e   global   complete   failed   Passed:  0, Failed:  0, Remaining:402
17:00:17 Sonobuoy has completed. Use `sonobuoy retrieve` to get results.
sonobuoy_e2e.tar.gz
Plugin: e2e
Status: failed
Total: 6607
Passed: 398
Failed: 8
Skipped: 6201

Failed tests:
 [sig-network] Services should have session affinity work for NodePort service [LinuxOnly] [Conformance]
 [sig-network] HostPort validates that there is no conflict between pods with same hostPort but different hostIP and protocol [LinuxOnly] [Conformance]
 [sig-network] Services should be able to switch session affinity for NodePort service [LinuxOnly] [Conformance]
 [sig-apps] Daemon set [Serial] should rollback without unnecessary restarts [Conformance]
 [sig-architecture] Conformance Tests should have at least two untainted nodes [Conformance]
 [sig-network] Services should be able to switch session affinity for service with type clusterIP [LinuxOnly] [Conformance]
 [sig-network] Services should serve endpoints on same port and different protocols [Conformance]
 [sig-network] Services should have session affinity work for service with type clusterIP [LinuxOnly] [Conformance]

The Ci job should fail if the underlying test fails. No one will look at the reports if the do not fail.

maci3jka commented 1 month ago

on moonray only two test failed https://github.com/canonical/k8s-snap/actions/runs/11323063651/job/31484966495?pr=715

bschimke95 commented 1 month ago

As written in MM: those tests fail for a reason (non-multinode cluster). Please resolve this issue before removing it from the pull request run.

bschimke95 commented 3 weeks ago

Once the tests pass ofc.