kumahq / kuma

🐻 The multi-zone service mesh for containers, Kubernetes and VMs. Built with Envoy. CNCF Sandbox Project.
https://kuma.io/install
Apache License 2.0
3.68k stars 333 forks source link

Reenable ignored e2e tests #8838

Open lahabana opened 10 months ago

lahabana commented 10 months ago

What happened?

We'd removed some in: https://github.com/kumahq/kuma/pull/8822

Here's a list of all tests:

➜  kuma git:(e2eImprovements) ~/go/bin/ginkgo run -v --dry-run ./test/e2e/... ./test/e2e_env/{multizone,universal,kubernetes}/... | grep -A2 'P \[PENDING\]'
P [PENDING]
Test Cleanup eBPF should cleanup ebpf files from node [job-0, arm-not-supported, legacy-k3s-not-supported]
/Users/charly.molter@konghq.com/code/kuma/test/e2e/ebpf/ebpf_cleanup.go:61
--
P [PENDING]
Test Global and Zone universal mode with Helm chart should deploy Zone and Global on 2 clusters [job-0]
/Users/charly.molter@konghq.com/code/kuma/test/e2e/helm/kuma_helm_deploy_global_and_zone_universal_mode.go:106
--
P [PENDING]
Test Zone and Global with Helm chart should execute admin operations on Global CP [job-2]
/Users/charly.molter@konghq.com/code/kuma/test/e2e/helm/kuma_helm_deploy_global_zone.go:174
--
P [PENDING]
Advanced LocalityAwareness with MeshLoadBalancingStrategy and Enabled Egress should route based on defined strategy with egress enabled
/Users/charly.molter@konghq.com/code/kuma/test/e2e_env/multizone/localityawarelb/locality_aware_multizone_hybrid_egress.go:149
--
P [PENDING]
External Service locality aware should route to external-service from universal through k8s
/Users/charly.molter@konghq.com/code/kuma/test/e2e_env/multizone/localityawarelb/locality_multizone_hybrid.go:136
--
P [PENDING]
External Services should check allow negotiation
/Users/charly.molter@konghq.com/code/kuma/test/e2e_env/universal/externalservices/externalservices.go:195
--
P [PENDING]
Transparent Proxy should be able to re-install transparent proxy
/Users/charly.molter@konghq.com/code/kuma/test/e2e_env/universal/transparentproxy/transparent_proxy.go:41
--
P [PENDING]
Change Service should gracefully switch to other service
/Users/charly.molter@konghq.com/code/kuma/test/e2e_env/kubernetes/graceful/change_service.go:109
github-actions[bot] commented 2 months ago

This issue was inactive for 90 days. It will be reviewed in the next triage meeting and might be closed. If you think this issue is still relevant, please comment on it or attend the next triage meeting.

jakubdyszkiewicz commented 2 months ago

Triage: update the list. What's still ignored?

lobkovilya commented 1 month ago

Triage: we'll need @jakubdyszkiewicz script to test them before enabling.

lukidzi commented 1 month ago

Updated list: Multizone

P [PENDING]
Resilience Postgres should mark zone as offline when zone control-plane is down
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/multizone/resilience/resilience_multizone_universal_postgres.go:177
------------------------------
P [PENDING]
Advanced LocalityAwareness with MeshLoadBalancingStrategy and Enabled Egress should route based on defined strategy with egress enabled
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/multizone/localityawarelb/locality_aware_multizone_hybrid_egress.go:157
------------------------------
P [PENDING]
MeshHTTPRoute No Zone Egress should use MeshHTTPRoute for cross-zone communication
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/multizone/meshhttproute/test.go:19
------------------------------
P [PENDING]
MeshHTTPRoute No Zone Egress should use MeshHTTPRoute for cross-zone with MeshServiceSubset
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/multizone/meshhttproute/test.go:19
------------------------------
P [PENDING]
MeshHTTPRoute Zone Egress should use MeshHTTPRoute for cross-zone communication
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/multizone/meshhttproute/test.go:23
------------------------------
P [PENDING]
MeshHTTPRoute Zone Egress should use MeshHTTPRoute for cross-zone with MeshServiceSubset
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/multizone/meshhttproute/test.go:23

Universal

P [PENDING]
Transparent Proxy should be able to re-install transparent proxy
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/universal/transparentproxy/transparent_proxy.go:47
------------------------------
P [PENDING]
External Services should check allow negotiation
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/universal/externalservices/externalservices.go:197
------------------------------
P [PENDING]
Mtls should enforce traffic permissions builtin CA
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/universal/mtls/mtls.go:193
------------------------------
P [PENDING]
Mtls should enforce traffic permissions Provided CA with Root CA
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/universal/mtls/mtls.go:203
------------------------------
P [PENDING]
Mtls should enforce traffic permissions Provided CA with Intermediate CA
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/universal/mtls/mtls.go:217
------------------------------
P [PENDING]
Mesh External Services MeshExternalService with MeshHealthCheck should target real MeshExternalService resource
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/universal/meshexternalservice/meshexternalservice.go:605
------------------------------
P [PENDING]
Mesh External Services MeshExternalService with MeshCircuitBreaker should target real MeshExternalService resource
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/universal/meshexternalservice/meshexternalservice.go:689
------------------------------
P [PENDING]
Mesh External Services MeshExternalService with MeshLoadBalancingStrategy should target real MeshExternalService resource
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/universal/meshexternalservice/meshexternalservice.go:763
------------------------------

Kubernetes

P [PENDING]
Change Service should gracefully switch to other service
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/kubernetes/graceful/change_service.go:133
------------------------------
P [PENDING]
Change Service should switch to the instance of a service that in not in the mesh
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/kubernetes/graceful/change_service.go:174
------------------------------
P [PENDING]
MeshMetric MeshMetric with OpenTelemetry enabled
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/kubernetes/meshmetric/meshmetric.go:604
------------------------------
P [PENDING]
MeshMetric MeshMetric with OpenTelemetry and usedonly/filter
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/kubernetes/meshmetric/meshmetric.go:621
------------------------------
P [PENDING]
MeshMetric MeshMetric with OpenTelemetry and Prometheus enabled
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/kubernetes/meshmetric/meshmetric.go:639
------------------------------
P [PENDING]
MeshMetric MeshMetric with multiple OpenTelemetry backends
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e_env/kubernetes/meshmetric/meshmetric.go:668
------------------------------

E2E legacy


P [PENDING]
Test Cleanup eBPF should cleanup ebpf files from node [job-0, arm-not-supported, legacy-k3s-not-supported]
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e/ebpf/ebpf_cleanup.go:61
------------------------------
P [PENDING]
Global and Zone universal mode with Helm chart should deploy Zone and Global on 2 clusters [job-0]
/Users/lukasz.dziedziak@konghq.com/Repository/kuma/test/e2e/helm/kuma_helm_deploy_global_and_zone_universal_mode.go:106
------------------------------