search

openshift / origin

Conformance test suite for OpenShift
http://www.openshift.org
Apache License 2.0
8.49k stars 4.7k forks source link

OPRUN-3570: Downstream testing of OpenShift Max Version property #29242

Closed gallettilance closed 1 week ago

openshift-ci-robot commented 2 weeks ago

@gallettilance: This pull request references OPRUN-3570 which is a valid jira issue.

Warning: The referenced jira issue has an invalid target version for the target branch this PR targets: expected the story to target the "4.18.0" version, but no target version was set.

In response to [this](https://github.com/openshift/origin/pull/29242): > Instructions for interacting with me using PR comments are available [here](https://prow.ci.openshift.org/command-help?repo=openshift%2Forigin). If you have questions or suggestions related to my behavior, please file an issue against the [openshift-eng/jira-lifecycle-plugin](https://github.com/openshift-eng/jira-lifecycle-plugin/issues/new) repository.
tmshort commented 2 weeks ago

/retest

tmshort commented 2 weeks ago

/payload-job periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview-serial

^^^ This should run some tech preview jobs (this was done in my #29249), which will ensure that the test actually run (and don't skip)

openshift-ci[bot] commented 2 weeks ago

@tmshort: trigger 2 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/55703700-9c57-11ef-914b-ba2721bb3330-0

openshift-ci[bot] commented 2 weeks ago

@tmshort: trigger 2 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/62190770-9c57-11ef-91db-101ddecd7889-0

tmshort commented 2 weeks ago

Didn't mean to run this twice... Don't edit comments with the /payload-job trigger!

jianzhangbjz commented 2 weeks ago

cc: @Xia-Zhao-rh ^^

tmshort commented 2 weeks ago

It does appear that the sig-olmv1 tests failed: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-origin-29242-ci-4.18-e2e-aws-ovn-techpreview/1854190700078305280 This looks like a serial vs parallel failure, as the serial test passed.

tmshort commented 2 weeks ago

/payload-job periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview-serial

openshift-ci[bot] commented 2 weeks ago

@tmshort: trigger 2 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/5aecb350-9d49-11ef-93e5-1cafd95c48bf-0

tmshort commented 2 weeks ago

We'll probably need to reach out to forum-ocp-release-oversight to get this approved once everything works

gallettilance commented 1 week ago

/test e2e-aws-ovn-single-node-upgrade

gallettilance commented 1 week ago

/test e2e-aws-ovn-single-node

gallettilance commented 1 week ago

/test e2e-aws-ovn-upgrade

gallettilance commented 1 week ago

/test e2e-metal-ipi-ovn

gallettilance commented 1 week ago

/test e2e-metal-ipi-ovn

tmshort commented 1 week ago

It only took 14 hours, but the techpreview tests passed...

dgoodwin commented 1 week ago

/approve

dgoodwin commented 1 week ago

/hold

Why did the last payload job attempt fail both jobs? https://github.com/openshift/origin/pull/29242#issuecomment-2463180053

tmshort commented 1 week ago

Yeah, it looks as though the tests are still not working in parallel @gallettilance See: https://prow.ci.openshift.org/view/gs/test-platform-results/logs/openshift-origin-29242-ci-4.18-e2e-aws-ovn-techpreview/1854626529070288896

openshift-trt-bot commented 1 week ago

Job Failure Risk Analysis for sha: 843a4ff7c414ad3a2ac83dfa7ba2096c3450a3d4

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node Low
[sig-node] static pods should start after being created
This test has passed 73.58% of 53 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-single-node'] in the last 14 days.

Open Bugs
Static pod controller pods sometimes fail to start [etcd]
openshift-trt-bot commented 1 week ago

Job Failure Risk Analysis for sha: eda89992745ea315333764681e05921862ee8672

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node Low
[sig-node] static pods should start after being created
This test has passed 73.58% of 53 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-single-node'] in the last 14 days.

Open Bugs
Static pod controller pods sometimes fail to start [etcd]
tmshort commented 1 week ago

/retest

None of the failures seem to be due to [sig-olmv1]

tmshort commented 1 week ago

/payload-job periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview-serial

openshift-ci[bot] commented 1 week ago

@tmshort: trigger 2 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/2f56ae60-a05c-11ef-8495-5dc2c6d006ec-0

openshift-ci[bot] commented 1 week ago

@gallettilance: The specified target(s) for /test were not found. The following commands are available to trigger required jobs:

The following commands are available to trigger optional jobs:

Use /test all to run the following jobs that were automatically triggered:

In response to [this](https://github.com/openshift/origin/pull/29242#issuecomment-2469475974): >/test ci/prow/e2e-aws-ovn-kube-apiserver-rollout ci/prow/e2e-aws-ovn-single-node-serial >ci/prow/e2e-metal-ipi-ovn-kube-apiserver-rollout Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes-sigs/prow](https://github.com/kubernetes-sigs/prow/issues/new?title=Prow%20issue:) repository.
gallettilance commented 1 week ago

/test e2e-aws-ovn-kube-apiserver-rollout e2e-aws-ovn-single-node-serial e2e-metal-ipi-ovn-kube-apiserver-rollout

tmshort commented 1 week ago

/retest

tmshort commented 1 week ago

/payload-job periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview-serial

This one had failed, but periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview passed

openshift-ci[bot] commented 1 week ago

@tmshort: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/ce06e270-a109-11ef-8957-2c8f7321d85d-0

tmshort commented 1 week ago

/lgtm

openshift-ci[bot] commented 1 week ago

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dgoodwin, gallettilance, tmshort

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files: - ~~[OWNERS](https://github.com/openshift/origin/blob/master/OWNERS)~~ [dgoodwin] Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment
tmshort commented 1 week ago

/retest

tmshort commented 1 week ago

/payload-job periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview-serial

openshift-ci[bot] commented 1 week ago

@tmshort: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/db210e50-a135-11ef-9985-44d3b4d55d8b-0

tmshort commented 1 week ago

/retest

openshift-trt-bot commented 1 week ago

Job Failure Risk Analysis for sha: 3400cd971b9991f18e6a2c316250ee65d33b22a9

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-kube-apiserver-rollout Low
[Conformance][Suite:openshift/kube-apiserver/rollout][Jira:"kube-apiserver"][sig-kube-apiserver] kube-apiserver should roll out new revisions without disruption [apigroup:config.openshift.io][apigroup:operator.openshift.io]
This test has passed 69.23% of 13 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-kube-apiserver-rollout'] in the last 14 days.
tmshort commented 1 week ago

/retest

tmshort commented 1 week ago

/payload-job periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview-serial

openshift-ci[bot] commented 1 week ago

@tmshort: trigger 1 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/c4026a80-a16b-11ef-8d50-be0d1b4bcabd-0

tmshort commented 1 week ago

/unhold

openshift-trt-bot commented 1 week ago

Job Failure Risk Analysis for sha: 3400cd971b9991f18e6a2c316250ee65d33b22a9

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-serial Medium
[bz-kube-apiserver][invariant] alert/KubeAPIErrorBudgetBurn should not be at or above info
This test has passed 96.61% of 59 runs on jobs ['periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-serial' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-serial'] in the last 14 days.

Open Bugs
SNO error rate for alert/KubeAPIErrorBudgetBurn should not be at or above info
openshift-ci-robot commented 1 week ago

/retest-required

Remaining retests: 0 against base HEAD bbbb03840e10ad313faf0bdf248e1c0bac816c0b and 2 for PR HEAD 3400cd971b9991f18e6a2c316250ee65d33b22a9 in total

openshift-ci[bot] commented 1 week ago

@gallettilance: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/e2e-metal-ipi-ovn-kube-apiserver-rollout 3400cd971b9991f18e6a2c316250ee65d33b22a9 link false /test e2e-metal-ipi-ovn-kube-apiserver-rollout
ci/prow/e2e-aws-ovn-single-node-serial 3400cd971b9991f18e6a2c316250ee65d33b22a9 link false /test e2e-aws-ovn-single-node-serial
ci/prow/okd-scos-e2e-aws-ovn 3400cd971b9991f18e6a2c316250ee65d33b22a9 link false /test okd-scos-e2e-aws-ovn

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes-sigs/prow](https://github.com/kubernetes-sigs/prow/issues/new?title=Prow%20issue:) repository. I understand the commands that are listed [here](https://go.k8s.io/bot-commands).
openshift-bot commented 1 week ago

[ART PR BUILD NOTIFIER]

Distgit: openshift-enterprise-tests This PR has been included in build openshift-enterprise-tests-container-v4.19.0-202411140737.p0.gd4dc765.assembly.stream.el9. All builds following this will include this PR.