search

openshift / origin

Conformance test suite for OpenShift
http://www.openshift.org
Apache License 2.0
8.44k stars 4.69k forks source link

DNM/TEST: increase num tries and frequency for endpoint checks #28677

Closed jluhrsen closed 3 weeks ago

jluhrsen commented 1 month ago

/hold not sure this works, but if so I have a PR to add a failing job to origin (always_run:false, optional:true) and hoping to use it with this PR as a presubmit to get more details on bug OCPBUGS-23957

openshift-ci[bot] commented 1 month ago

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: jluhrsen Once this PR has been reviewed and has the lgtm label, please assign neisw for approval. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files: - **[OWNERS](https://github.com/openshift/origin/blob/master/OWNERS)** Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment
jluhrsen commented 1 month ago

/test give-me-a-list

openshift-ci[bot] commented 1 month ago

@jluhrsen: The specified target(s) for /test were not found. The following commands are available to trigger required jobs:

The following commands are available to trigger optional jobs:

Use /test all to run the following jobs that were automatically triggered:

In response to [this](https://github.com/openshift/origin/pull/28677#issuecomment-2026399569): >/test give-me-a-list Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.
jluhrsen commented 1 month ago

/test e2e-metal-ipi-ovn-dualstack-local-gateway

jluhrsen commented 1 month ago

/test e2e-metal-ipi-ovn-dualstack-local-gateway

jluhrsen commented 1 month ago

/test e2e-metal-ipi-ovn-dualstack-local-gateway

jluhrsen commented 1 month ago

/test e2e-metal-ipi-ovn-dualstack-local-gateway

jluhrsen commented 4 weeks ago

/test e2e-metal-ipi-ovn-dualstack-local-gateway

jluhrsen commented 4 weeks ago

/test e2e-metal-ipi-ovn-dualstack-local-gateway

jluhrsen commented 4 weeks ago

/test e2e-metal-ipi-ovn-dualstack-local-gateway

openshift-trt-bot commented 4 weeks ago

Job Failure Risk Analysis for sha: 04d6e0c3b989e767bcb1f500147587b28c81ebf8

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-dualstack-local-gateway High
[sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should update endpoints: http [Suite:openshift/conformance/parallel] [Suite:k8s]
This test has passed 100.00% of 13 runs on release 4.16 [amd64 ha metal-ipi ovn] in the last week.
---
[sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should function for service endpoints using hostNetwork [Suite:openshift/conformance/parallel] [Suite:k8s]
This test has passed 100.00% of 13 runs on release 4.16 [amd64 ha metal-ipi ovn] in the last week.

Open Bugs
Several openshift conformance/parallel tests fail when running OCP 4.14 UPI Tech Preview
---
[sig-network] Networking Granular Checks: Services should update endpoints: http [Suite:openshift/conformance/parallel] [Suite:k8s]
This test has passed 99.25% of 2275 runs on release 4.16 [Overall] in the last week.
---
[sig-network] [Feature:IPv6DualStack] Granular Checks: Services Secondary IP Family [LinuxOnly] should update endpoints: udp [Suite:openshift/conformance/parallel] [Suite:k8s]
This test has passed 100.00% of 13 runs on release 4.16 [amd64 ha metal-ipi ovn] in the last week.
---
Showing 4 of 5 test results
pull-ci-openshift-origin-master-e2e-aws-ovn-fips High
[sig-network] Networking Granular Checks: Services should update endpoints: udp [Suite:openshift/conformance/parallel] [Suite:k8s]
This test has passed 100.00% of 34 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.16-e2e-aws-ovn-fips'] in the last 14 days.
---
[sig-network] Networking Granular Checks: Services should update endpoints: http [Suite:openshift/conformance/parallel] [Suite:k8s]
This test has passed 100.00% of 34 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.16-e2e-aws-ovn-fips'] in the last 14 days.
pull-ci-openshift-origin-master-e2e-aws-ovn-cgroupsv2 High
[sig-network] Networking Granular Checks: Services should update endpoints: udp [Suite:openshift/conformance/parallel] [Suite:k8s]
This test has passed 99.21% of 2275 runs on release 4.16 [Overall] in the last week.
---
[sig-network] Networking Granular Checks: Services should update endpoints: http [Suite:openshift/conformance/parallel] [Suite:k8s]
This test has passed 99.25% of 2275 runs on release 4.16 [Overall] in the last week.
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-ipv6 IncompleteTests
Tests for this run (101) are below the historical average (1182): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-agnostic-ovn-cmd IncompleteTests
Tests for this run (26) are below the historical average (581): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-serial Low
[sig-arch] events should not repeat pathologically for ns/openshift-etcd-operator
This test has passed 28.99% of 69 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.16-e2e-aws-ovn-single-node-serial'] in the last 14 days.
jluhrsen commented 3 weeks ago

/test e2e-metal-ipi-ovn-dualstack-local-gateway

jluhrsen commented 3 weeks ago

/test e2e-metal-ipi-ovn-dualstack-local-gateway

jluhrsen commented 3 weeks ago

/test e2e-metal-ipi-ovn-dualstack-local-gateway

openshift-ci[bot] commented 3 weeks ago

@jluhrsen: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-gcp-csi d5c32599c04cb608db865930f8944e0f3a44e778 link false /test e2e-gcp-csi
ci/prow/verify-deps d5c32599c04cb608db865930f8944e0f3a44e778 link true /test verify-deps
ci/prow/e2e-gcp-ovn-rt-upgrade d5c32599c04cb608db865930f8944e0f3a44e778 link false /test e2e-gcp-ovn-rt-upgrade
ci/prow/e2e-aws-ovn-cgroupsv2 d5c32599c04cb608db865930f8944e0f3a44e778 link false /test e2e-aws-ovn-cgroupsv2
ci/prow/e2e-gcp-ovn d5c32599c04cb608db865930f8944e0f3a44e778 link true /test e2e-gcp-ovn
ci/prow/unit d5c32599c04cb608db865930f8944e0f3a44e778 link true /test unit
ci/prow/e2e-aws-ovn-single-node-upgrade d5c32599c04cb608db865930f8944e0f3a44e778 link false /test e2e-aws-ovn-single-node-upgrade
ci/prow/images d5c32599c04cb608db865930f8944e0f3a44e778 link true /test images
ci/prow/e2e-aws-ovn-fips d5c32599c04cb608db865930f8944e0f3a44e778 link true /test e2e-aws-ovn-fips
ci/prow/e2e-metal-ipi-ovn-dualstack-local-gateway d5c32599c04cb608db865930f8944e0f3a44e778 link false /test e2e-metal-ipi-ovn-dualstack-local-gateway
ci/prow/e2e-metal-ipi-ovn-ipv6 d5c32599c04cb608db865930f8944e0f3a44e778 link true /test e2e-metal-ipi-ovn-ipv6
ci/prow/e2e-aws-ovn-single-node d5c32599c04cb608db865930f8944e0f3a44e778 link false /test e2e-aws-ovn-single-node
ci/prow/e2e-agnostic-ovn-cmd d5c32599c04cb608db865930f8944e0f3a44e778 link false /test e2e-agnostic-ovn-cmd
ci/prow/e2e-metal-ipi-sdn d5c32599c04cb608db865930f8944e0f3a44e778 link false /test e2e-metal-ipi-sdn
ci/prow/e2e-gcp-ovn-upgrade d5c32599c04cb608db865930f8944e0f3a44e778 link true /test e2e-gcp-ovn-upgrade
ci/prow/e2e-openstack-ovn d5c32599c04cb608db865930f8944e0f3a44e778 link false /test e2e-openstack-ovn
ci/prow/verify d5c32599c04cb608db865930f8944e0f3a44e778 link true /test verify

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository. I understand the commands that are listed [here](https://go.k8s.io/bot-commands).
openshift-trt-bot commented 3 weeks ago

Job Failure Risk Analysis for sha: d5c32599c04cb608db865930f8944e0f3a44e778

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-metal-ipi-sdn IncompleteTests
Tests for this run (101) are below the historical average (1494): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-ipv6 IncompleteTests
Tests for this run (99) are below the historical average (1107): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-gcp-ovn-upgrade IncompleteTests
Tests for this run (15) are below the historical average (583): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-gcp-ovn-rt-upgrade IncompleteTests
Tests for this run (15) are below the historical average (563): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-gcp-ovn IncompleteTests
Tests for this run (14) are below the historical average (1542): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-agnostic-ovn-cmd IncompleteTests
Tests for this run (14) are below the historical average (531): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
jluhrsen commented 3 weeks ago

not working on this bug any more