search

openshift / origin

Conformance test suite for OpenShift
http://www.openshift.org
Apache License 2.0
8.49k stars 4.7k forks source link

SDN-5346: virt, live-migration: add layer2 LM tests #29199

Closed qinqon closed 2 weeks ago

qinqon commented 1 month ago

These tests are isolated in a separate suite, so we do not have to skips tests when OpenShift virtualization is not deployed in the cluster.

This add final tests for VM/VMIs, restart/liveMigration and secondary/primary UDN tests.

For primary UDN the vmi status do not present the IPs yet so the guest is inspected, in the future the expected address can be retrieved from the VMI status for primary UDNs too, although guest will have to be inspected to ensure that the DHCP/NDP from OVN is working as expected.

TODO:

Based-on:

Depends-on:

openshift-trt-bot commented 1 month ago

Job Failure Risk Analysis for sha: 6cabd5f7ebea1ecb98f335167f121f060663c88c

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-openstack-ovn IncompleteTests
Tests for this run (2) are below the historical average (2540): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-kube-apiserver-rollout IncompleteTests
Tests for this run (2) are below the historical average (1305): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-ipv6 IncompleteTests
Tests for this run (2) are below the historical average (2407): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn IncompleteTests
Tests for this run (2) are below the historical average (2448): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-gcp-ovn-upgrade IncompleteTests
Tests for this run (2) are below the historical average (1509): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-gcp-ovn-rt-upgrade IncompleteTests
Tests for this run (2) are below the historical average (1486): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-gcp-ovn IncompleteTests
Tests for this run (2) are below the historical average (2584): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-gcp-csi IncompleteTests
Tests for this run (2) are below the historical average (1471): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade-rollback IncompleteTests
Tests for this run (2) are below the historical average (510): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade IncompleteTests
Tests for this run (2) are below the historical average (1509): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade IncompleteTests
Tests for this run (2) are below the historical average (3837): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-serial IncompleteTests
Tests for this run (2) are below the historical average (1447): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node IncompleteTests
Tests for this run (2) are below the historical average (2478): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-serial IncompleteTests
Tests for this run (2) are below the historical average (1566): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-microshift-serial IncompleteTests
Tests for this run (2) are below the historical average (597): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-microshift IncompleteTests
Tests for this run (2) are below the historical average (1375): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-kube-apiserver-rollout IncompleteTests
Tests for this run (2) are below the historical average (1404): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-fips IncompleteTests
Tests for this run (2) are below the historical average (2759): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-edge-zones IncompleteTests
Tests for this run (2) are below the historical average (2795): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-cgroupsv2 IncompleteTests
Tests for this run (2) are below the historical average (2597): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Showing 20 of 22 jobs analysis

qinqon commented 1 month ago

/payload-job-with-prs pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview openshift/origin#29199

openshift-ci[bot] commented 1 month ago

@qinqon: trigger 0 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

openshift-ci[bot] commented 1 month ago

@qinqon: This PR was included in a payload test run from openshift/origin#29199 trigger 0 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

qinqon commented 1 month ago

/payload-job-with-prs pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview #openshift/release/57947

openshift-ci[bot] commented 1 month ago

@qinqon: An error was encountered. No known errors were detected, please see the full error message for details.

Full error message. unable to get additional pr info from string: #openshift/release/57947: string: #openshift/release/57947 doesn't match expected format: org/repo#number

Please contact an administrator to resolve this issue.

qinqon commented 1 month ago

/payload-job-with-prs pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview openshift/release#57947

openshift-ci[bot] commented 1 month ago

@qinqon: trigger 0 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

openshift-trt-bot commented 1 month ago

Job Failure Risk Analysis for sha: 5c137be34abc5bee14a272706b0e8b7533f771b1

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-openstack-ovn IncompleteTests
Tests for this run (2) are below the historical average (2425): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-kube-apiserver-rollout IncompleteTests
Tests for this run (2) are below the historical average (1306): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-ipv6 IncompleteTests
Tests for this run (2) are below the historical average (2443): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn IncompleteTests
Tests for this run (2) are below the historical average (2493): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-gcp-ovn-upgrade IncompleteTests
Tests for this run (2) are below the historical average (1537): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-gcp-ovn-rt-upgrade IncompleteTests
Tests for this run (2) are below the historical average (1542): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-gcp-ovn IncompleteTests
Tests for this run (2) are below the historical average (2568): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-gcp-csi IncompleteTests
Tests for this run (2) are below the historical average (1508): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade IncompleteTests
Tests for this run (2) are below the historical average (1468): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade IncompleteTests
Tests for this run (2) are below the historical average (3758): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-serial IncompleteTests
Tests for this run (2) are below the historical average (1418): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node IncompleteTests
Tests for this run (2) are below the historical average (2424): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-serial IncompleteTests
Tests for this run (2) are below the historical average (1548): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-microshift-serial IncompleteTests
Tests for this run (2) are below the historical average (565): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-microshift IncompleteTests
Tests for this run (2) are below the historical average (1340): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-kube-apiserver-rollout IncompleteTests
Tests for this run (2) are below the historical average (1394): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-fips IncompleteTests
Tests for this run (2) are below the historical average (2708): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-edge-zones IncompleteTests
Tests for this run (2) are below the historical average (2732): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-cgroupsv2 IncompleteTests
Tests for this run (2) are below the historical average (2487): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-csi IncompleteTests
Tests for this run (2) are below the historical average (1427): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)

Showing 20 of 22 jobs analysis

openshift-ci-robot commented 1 month ago

@qinqon: This pull request explicitly references no jira issue.

In response to [this](https://github.com/openshift/origin/pull/29199): >These tests are isolated in a separate suite, so we do not have to >skips tests when OpenShift virtualization is *not* deployed in the >cluster. > >This add final tests for VM/VMIs, restart/liveMigration and >secondary/primary UDN tests. > >For primary UDN the vmi status do not present the IPs yet so the guest >is inspected, in the future the expected address can be retrieved from >the VMI status for primary UDNs too, although guest will have to be >inspected to ensure that the DHCP/NDP from OVN is working as expected. > >Based-on: >- https://github.com/openshift/origin/pull/29186 > Instructions for interacting with me using PR comments are available [here](https://prow.ci.openshift.org/command-help?repo=openshift%2Forigin). If you have questions or suggestions related to my behavior, please file an issue against the [openshift-eng/jira-lifecycle-plugin](https://github.com/openshift-eng/jira-lifecycle-plugin/issues/new) repository.
openshift-trt-bot commented 1 month ago

Job Failure Risk Analysis for sha: 8fe69aa962f62424817ca271b41f2b57df58a4b7

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade-rollback Medium
[sig-sippy] infrastructure should work
This test has passed 90.85% of 6517 runs on release 4.18 [Overall] in the last week.
qinqon commented 1 month ago

/payload-job pull-ci-openshift-priv-ovn-kubernetes-master-e2e-aws-ovn-virt-techpreview

openshift-ci[bot] commented 1 month ago

@qinqon: trigger 0 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

openshift-ci[bot] commented 1 month ago

@qinqon: This PR was included in a payload test run from openshift/ovn-kubernetes#2324 trigger 0 job(s) for the /payload-(with-prs|job|aggregate|job-with-prs|aggregate-with-prs) command

qinqon commented 1 month ago

/test pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview

qinqon commented 1 month ago

/test pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview

openshift-ci[bot] commented 1 month ago

@qinqon: The specified target(s) for /test were not found. The following commands are available to trigger required jobs:

The following commands are available to trigger optional jobs:

Use /test all to run the following jobs that were automatically triggered:

In response to [this](https://github.com/openshift/origin/pull/29199#issuecomment-2425945493): >/test pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes-sigs/prow](https://github.com/kubernetes-sigs/prow/issues/new?title=Prow%20issue:) repository.
qinqon commented 1 month ago

/test pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview

openshift-ci[bot] commented 1 month ago

@qinqon: The specified target(s) for /test were not found. The following commands are available to trigger required jobs:

The following commands are available to trigger optional jobs:

Use /test all to run the following jobs that were automatically triggered:

In response to [this](https://github.com/openshift/origin/pull/29199#issuecomment-2425955326): >/test pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes-sigs/prow](https://github.com/kubernetes-sigs/prow/issues/new?title=Prow%20issue:) repository.
qinqon commented 1 month ago

/test e2e-aws-ovn-virt-techpreview

qinqon commented 1 month ago

Looks like the feature gates at HCO are not correctly configured 

 I1021 10:13:44.830490 41946 client.go:934] Running 'oc --namespace=e2e-test-network-segmentation-e2e-mk9h4 --kubeconfig=/tmp/configfile594993083 get vmi myvm -o jsonpath="{@.status.conditions}"'
    STEP: The retrieved VM state: [{"lastProbeTime":"2024-10-21T10:08:52Z","lastTransitionTime":"2024-10-21T10:08:52Z","message":"virt-launcher pod has not yet been scheduled","reason":"PodNotExists","status":"False","type":"Ready"},{"lastProbeTime":null,"lastTransitionTime":"2024-10-21T10:08:52Z","message":"failed to render launch manifest: couldn't find configuration for network bindining: passt","reason":"FailedCreate","status":"False","type":"Synchronized"}] @ 10/21/24 10:13:45.03
qinqon commented 1 month ago

HCO FG for primary UDN is ignored 

featureGates:                                                               
      alignCPUs: false                                                          
      autoResourceLimits: false                                                 
      deployKubeSecondaryDNS: false                                             
      deployKubevirtIpamController: true                                        
      deployTektonTaskResources: false                                          
      deployVmConsoleProxy: false                                               
      disableMDevConfiguration: false                                           
      downwardMetrics: false                                                    
      enableApplicationAwareQuota: false                                        
      enableCommonBootImageImport: false                                        
      enableManagedTenantQuota: false                                           
      nonRoot: true                                                             
      persistentReservation: false                                              
      withHostPassthroughCPU: false
openshift-trt-bot commented 1 month ago

Job Failure Risk Analysis for sha: adf8bbf6681dd0c8eebd521008fa04adb7f0b25d

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade-rollback Medium
[sig-sippy] infrastructure should work
This test has passed 91.38% of 6067 runs on release 4.18 [Overall] in the last week.
pull-ci-openshift-origin-master-e2e-aws-ovn-kube-apiserver-rollout Low
[Conformance][Suite:openshift/kube-apiserver/rollout][Jira:"kube-apiserver"][sig-kube-apiserver] kube-apiserver should roll out new revisions without disruption [apigroup:config.openshift.io][apigroup:operator.openshift.io]
This test has passed 38.46% of 13 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-kube-apiserver-rollout'] in the last 14 days.
qinqon commented 1 month ago

All test passing locally.

qinqon commented 1 month ago

/test pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview

openshift-ci[bot] commented 1 month ago

@qinqon: The specified target(s) for /test were not found. The following commands are available to trigger required jobs:

The following commands are available to trigger optional jobs:

Use /test all to run the following jobs that were automatically triggered:

In response to [this](https://github.com/openshift/origin/pull/29199#issuecomment-2429078361): >/test pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes-sigs/prow](https://github.com/kubernetes-sigs/prow/issues/new?title=Prow%20issue:) repository.
qinqon commented 1 month ago

/test e2e-aws-ovn-virt-techpreview

openshift-trt-bot commented 1 month ago

Job Failure Risk Analysis for sha: 4a46eb7070552f03dd2a7bb01ff19a6a25c6dc58

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview High
[sig-arch] Only known images used by tests
This test has passed 100.00% of 81 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.
---
[sig-arch] events should not repeat pathologically
This test has passed 100.00% of 81 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.

Open Bugs
Machine-API healthz probe failure on SNO Upgrades
unnecessary daemonset / deployment rollouts on vsphere
---
[sig-trt][invariant] No new alerts should be firing
This test has passed 100.00% of 81 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-kube-apiserver-rollout IncompleteTests
Tests for this run (101) are below the historical average (1126): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-ipv6 IncompleteTests
Tests for this run (101) are below the historical average (1944): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade-rollback Medium
[sig-sippy] infrastructure should work
This test has passed 91.05% of 5834 runs on release 4.18 [Overall] in the last week.
qinqon commented 1 month ago

/test e2e-aws-ovn-virt-techpreview

openshift-trt-bot commented 1 month ago

Job Failure Risk Analysis for sha: 4a46eb7070552f03dd2a7bb01ff19a6a25c6dc58

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview High
[sig-arch] Only known images used by tests
This test has passed 100.00% of 82 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.
---
[sig-arch] events should not repeat pathologically
This test has passed 100.00% of 82 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.

Open Bugs
Machine-API healthz probe failure on SNO Upgrades
unnecessary daemonset / deployment rollouts on vsphere
---
[sig-trt][invariant] No new alerts should be firing
This test has passed 100.00% of 82 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-kube-apiserver-rollout IncompleteTests
Tests for this run (101) are below the historical average (1056): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-ipv6 IncompleteTests
Tests for this run (101) are below the historical average (1776): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade-rollback Medium
[sig-sippy] infrastructure should work
This test has passed 90.99% of 5885 runs on release 4.18 [Overall] in the last week.
qinqon commented 1 month ago

/test e2e-aws-ovn-virt-techpreview

openshift-trt-bot commented 1 month ago

Job Failure Risk Analysis for sha: 22857445deeb8faef3722b3fc90276d96c4b7040

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview High
[sig-trt][invariant] No new alerts should be firing
This test has passed 100.00% of 84 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.
---
[sig-arch] Only known images used by tests
This test has passed 100.00% of 84 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.
---
[sig-arch] events should not repeat pathologically
This test has passed 100.00% of 84 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.

Open Bugs
unnecessary daemonset / deployment rollouts on vsphere
Machine-API healthz probe failure on SNO Upgrades
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-kube-apiserver-rollout IncompleteTests
Tests for this run (101) are below the historical average (1041): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade-rollback Medium
[sig-sippy] infrastructure should work
This test has passed 90.91% of 5875 runs on release 4.18 [Overall] in the last week.
pull-ci-openshift-origin-master-e2e-aws-ovn-single-node-upgrade Medium
[sig-architecture] platform pods in ns/openshift-e2e-loki should not exit an excessive amount of times
This test has passed 95.30% of 234 runs on release 4.18 [Architecture:amd64 FeatureSet:default Installer:ipi Network:ovn NetworkStack:ipv4 Platform:aws SecurityMode:default Topology:single Upgrade:micro] in the last week.
openshift-trt-bot commented 1 month ago

Job Failure Risk Analysis for sha: 22857445deeb8faef3722b3fc90276d96c4b7040

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview High
[sig-trt][invariant] No new alerts should be firing
This test has passed 100.00% of 85 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.
---
[sig-arch] Only known images used by tests
This test has passed 100.00% of 85 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.
---
[sig-arch] events should not repeat pathologically
This test has passed 100.00% of 85 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.

Open Bugs
unnecessary daemonset / deployment rollouts on vsphere
Machine-API healthz probe failure on SNO Upgrades
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-kube-apiserver-rollout IncompleteTests
Tests for this run (101) are below the historical average (1048): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade-rollback Medium
[sig-sippy] infrastructure should work
This test has passed 90.91% of 5875 runs on release 4.18 [Overall] in the last week.
qinqon commented 1 month ago

/test e2e-aws-ovn-virt-techpreview

openshift-trt-bot commented 1 month ago

Job Failure Risk Analysis for sha: 22857445deeb8faef3722b3fc90276d96c4b7040

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview High
[sig-arch] events should not repeat pathologically
This test has passed 100.00% of 85 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.

Open Bugs
unnecessary daemonset / deployment rollouts on vsphere
Machine-API healthz probe failure on SNO Upgrades
---
[sig-arch] Only known images used by tests
This test has passed 100.00% of 85 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.
---
[sig-trt][invariant] No new alerts should be firing
This test has passed 100.00% of 85 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.
pull-ci-openshift-origin-master-e2e-metal-ipi-ovn-kube-apiserver-rollout IncompleteTests
Tests for this run (101) are below the historical average (1053): IncompleteTests (not enough tests ran to make a reasonable risk analysis; this could be due to infra, installation, or upgrade problems)
pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade-rollback Medium
[sig-sippy] infrastructure should work
This test has passed 90.82% of 5727 runs on release 4.18 [Overall] in the last week.
qinqon commented 1 month ago

This is the repeated event that is disturbing monitor tests, does not look like an error 

 {
            "apiVersion": "v1",
            "count": 45,
            "eventTime": null,
            "firstTimestamp": "2024-10-23T20:20:50Z",
            "involvedObject": {
                "apiVersion": "cdi.kubevirt.io/v1beta1",
                "kind": "CDI",
                "name": "cdi-kubevirt-hyperconverged",
                "resourceVersion": "46012",
                "uid": "fe08b457-7fb8-4d9d-b7b5-b1644a56c866"
            },
            "kind": "Event",
            "lastTimestamp": "2024-10-23T20:45:59Z",
            "message": "Successfully ensured SecurityContextConstraint exists",
            "metadata": {
                "creationTimestamp": "2024-10-23T20:25:52Z",
                "name": "cdi-kubevirt-hyperconverged.18012e7df5cf1e93",
                "namespace": "default",
                "resourceVersion": "72981",
                "uid": "99d1c380-6199-4c67-b60d-58c45b8e5fad"
            },
            "reason": "CreateResourceSuccess",
            "reportingComponent": "operator-controller",
            "reportingInstance": "",
            "source": {
                "component": "operator-controller"
            },
            "type": "Normal"
        },
qinqon commented 1 month ago

Alerts:

 - alert: CDIDefaultStorageClassDegraded                                 
          annotations:                                                          
            runbook_url: https://github.com/openshift/runbooks/blob/master/alerts/openshift-virtualization-operator/CDIDefaultStorageClassDegraded.md
            summary: Default storage class has no smart clone or ReadWriteMany  
          expr: "sum(kubevirt_cdi_storageprofile_info{default=\"true\",degraded=\"false\"}
            or on() vector(0)) +\n\t\t\t\t\t\t\t\t sum(kubevirt_cdi_storageprofile_info{virtdefault=\"true\",degraded=\"false\"}
            or on() vector(0)) +\n\t\t\t\t\t\t\t\t on () (0*(sum(kubevirt_cdi_storageprofile_info{default=\"true\"})
            or sum(kubevirt_cdi_storageprofile_info{virtdefault=\"true\"}))) == 0"
          for: 5m                                                               
          labels:                                                               
            kubernetes_operator_component: containerized-data-importer          
            kubernetes_operator_part_of: kubevirt                               
            operator_health_impact: none                                        
            severity: warning                    
    - alert: VirtControllerRESTErrorsHigh                                       
      annotations:                                                              
        runbook_url: https://github.com/openshift/runbooks/blob/master/alerts/openshift-virtualization-operator/VirtControllerRESTErrorsHigh.md
        summary: More than 5% of the rest calls failed in virt-controller for the
          last hour                                                             
      expr: sum ( rate ( kubevirt_rest_client_requests_total{namespace="openshift-cnv",pod=~"virt-controller-.*",code=~"(4|5)[0-9][0-9]"}
        [60m] ) )  /  sum ( rate ( kubevirt_rest_client_requests_total{namespace="openshift-cnv",pod=~"virt-controller-.*"}
        [60m] ) ) >= 0.05                                                       
      labels:                                                                   
        kubernetes_operator_component: kubevirt                                 
        kubernetes_operator_part_of: kubevirt                                   
        operator_health_impact: warning                                         
        severity: warning                                            
    - alert: VirtHandlerRESTErrorsHigh                                          
      annotations:                                                              
        runbook_url: https://github.com/openshift/runbooks/blob/master/alerts/openshift-virtualization-operator/VirtHandlerRESTErrorsHigh.md
        summary: More than 5% of the rest calls failed in virt-handler for the last
          hour                                                                  
      expr: sum ( rate ( kubevirt_rest_client_requests_total{namespace="openshift-cnv",pod=~"virt-handler-.*",code=~"(4|5)[0-9][0-9]"}
        [60m] ) )  /  sum ( rate ( kubevirt_rest_client_requests_total{namespace="openshift-cnv",pod=~"virt-handler-.*"}
        [60m] ) ) >= 0.05                                                       
      labels:                                                                   
        kubernetes_operator_component: kubevirt                                 
        kubernetes_operator_part_of: kubevirt                                   
        operator_health_impact: warning                                         
        severity: warning
qinqon commented 1 month ago

/test e2e-aws-ovn-virt-techpreview

maiqueb commented 1 month ago

why NO-JIRA ? Can't you just use https://issues.redhat.com/browse/SDN-5346 ?

qinqon commented 1 month ago

why NO-JIRA ? Can't you just use https://issues.redhat.com/browse/SDN-5346 ?

Ahh didn't know let me add it.

openshift-ci-robot commented 1 month ago

@qinqon: This pull request references SDN-5346 which is a valid jira issue.

In response to [this](https://github.com/openshift/origin/pull/29199): >These tests are isolated in a separate suite, so we do not have to >skips tests when OpenShift virtualization is *not* deployed in the >cluster. > >This add final tests for VM/VMIs, restart/liveMigration and >secondary/primary UDN tests. > >For primary UDN the vmi status do not present the IPs yet so the guest >is inspected, in the future the expected address can be retrieved from >the VMI status for primary UDNs too, although guest will have to be >inspected to ensure that the DHCP/NDP from OVN is working as expected. > >TODO: >- [x] east/west traffic > >Based-on: >- https://github.com/openshift/origin/pull/29186 > Instructions for interacting with me using PR comments are available [here](https://prow.ci.openshift.org/command-help?repo=openshift%2Forigin). If you have questions or suggestions related to my behavior, please file an issue against the [openshift-eng/jira-lifecycle-plugin](https://github.com/openshift-eng/jira-lifecycle-plugin/issues/new) repository.
qinqon commented 1 month ago

/jira refresh

openshift-ci-robot commented 1 month ago

@qinqon: This pull request references SDN-5346 which is a valid jira issue.

In response to [this](https://github.com/openshift/origin/pull/29199#issuecomment-2434935962): >/jira refresh Instructions for interacting with me using PR comments are available [here](https://prow.ci.openshift.org/command-help?repo=openshift%2Forigin). If you have questions or suggestions related to my behavior, please file an issue against the [openshift-eng/jira-lifecycle-plugin](https://github.com/openshift-eng/jira-lifecycle-plugin/issues/new) repository.
openshift-ci-robot commented 1 month ago

@qinqon: This pull request references SDN-5346 which is a valid jira issue.

In response to [this](https://github.com/openshift/origin/pull/29199): >These tests are isolated in a separate suite, so we do not have to >skips tests when OpenShift virtualization is *not* deployed in the >cluster. > >This add final tests for VM/VMIs, restart/liveMigration and >secondary/primary UDN tests. > >For primary UDN the vmi status do not present the IPs yet so the guest >is inspected, in the future the expected address can be retrieved from >the VMI status for primary UDNs too, although guest will have to be >inspected to ensure that the DHCP/NDP from OVN is working as expected. > >TODO: >- [x] east/west traffic > >Based-on: >- https://github.com/openshift/origin/pull/29186 > >Depends-on: >- https://github.com/openshift/origin/pull/29229 Instructions for interacting with me using PR comments are available [here](https://prow.ci.openshift.org/command-help?repo=openshift%2Forigin). If you have questions or suggestions related to my behavior, please file an issue against the [openshift-eng/jira-lifecycle-plugin](https://github.com/openshift-eng/jira-lifecycle-plugin/issues/new) repository.
openshift-trt-bot commented 1 month ago

Job Failure Risk Analysis for sha: 8984bba2d706c714282260c02d0e53d9da82dca3

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview High
[sig-arch] events should not repeat pathologically
This test has passed 100.00% of 87 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.

Open Bugs
Machine-API healthz probe failure on SNO Upgrades
---
[sig-trt][invariant] No new alerts should be firing
This test has passed 100.00% of 87 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.
pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade-rollback Medium
[sig-sippy] infrastructure should work
This test has passed 92.34% of 5850 runs on release 4.18 [Overall] in the last week.
openshift-trt-bot commented 1 month ago

Job Failure Risk Analysis for sha: 8984bba2d706c714282260c02d0e53d9da82dca3

Job Name Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-virt-techpreview High
[sig-arch] events should not repeat pathologically
This test has passed 100.00% of 87 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.

Open Bugs
Machine-API healthz probe failure on SNO Upgrades
---
[sig-trt][invariant] No new alerts should be firing
This test has passed 100.00% of 87 runs on jobs ['periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-cgroupsv1-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-crun-techpreview' 'periodic-ci-openshift-release-master-ci-4.18-e2e-aws-ovn-techpreview' 'periodic-ci-openshift-release-master-nightly-4.18-e2e-aws-ovn-shared-vpc-phz-techpreview'] in the last 14 days.
pull-ci-openshift-origin-master-e2e-aws-ovn-upgrade-rollback Medium
[sig-sippy] infrastructure should work
This test has passed 92.34% of 5850 runs on release 4.18 [Overall] in the last week.
openshift-ci-robot commented 1 month ago

@qinqon: This pull request references SDN-5346 which is a valid jira issue.

In response to [this](https://github.com/openshift/origin/pull/29199): >These tests are isolated in a separate suite, so we do not have to >skips tests when OpenShift virtualization is *not* deployed in the >cluster. > >This add final tests for VM/VMIs, restart/liveMigration and >secondary/primary UDN tests. > >For primary UDN the vmi status do not present the IPs yet so the guest >is inspected, in the future the expected address can be retrieved from >the VMI status for primary UDNs too, although guest will have to be >inspected to ensure that the DHCP/NDP from OVN is working as expected. > >TODO: >- [x] east/west traffic > >Based-on: >- https://github.com/openshift/origin/pull/29186 > >Depends-on: >- https://github.com/openshift/origin/pull/29229 >- https://github.com/kubevirt/containerized-data-importer/pull/3477 Instructions for interacting with me using PR comments are available [here](https://prow.ci.openshift.org/command-help?repo=openshift%2Forigin). If you have questions or suggestions related to my behavior, please file an issue against the [openshift-eng/jira-lifecycle-plugin](https://github.com/openshift-eng/jira-lifecycle-plugin/issues/new) repository.
openshift-ci-robot commented 1 month ago

@qinqon: This pull request references SDN-5346 which is a valid jira issue.

In response to [this](https://github.com/openshift/origin/pull/29199): >These tests are isolated in a separate suite, so we do not have to >skips tests when OpenShift virtualization is *not* deployed in the >cluster. > >This add final tests for VM/VMIs, restart/liveMigration and >secondary/primary UDN tests. > >For primary UDN the vmi status do not present the IPs yet so the guest >is inspected, in the future the expected address can be retrieved from >the VMI status for primary UDNs too, although guest will have to be >inspected to ensure that the DHCP/NDP from OVN is working as expected. > >TODO: >- [x] east/west traffic > >Based-on: >- https://github.com/openshift/origin/pull/29186 > >Depends-on: >- https://github.com/openshift/origin/pull/29229 >- https://github.com/kubevirt/containerized-data-importer/pull/3477 >- https://github.com/kubevirt/cluster-network-addons-operator/pull/1922 Instructions for interacting with me using PR comments are available [here](https://prow.ci.openshift.org/command-help?repo=openshift%2Forigin). If you have questions or suggestions related to my behavior, please file an issue against the [openshift-eng/jira-lifecycle-plugin](https://github.com/openshift-eng/jira-lifecycle-plugin/issues/new) repository.
openshift-ci-robot commented 1 month ago

@qinqon: This pull request references SDN-5346 which is a valid jira issue.

In response to [this](https://github.com/openshift/origin/pull/29199): >These tests are isolated in a separate suite, so we do not have to >skips tests when OpenShift virtualization is *not* deployed in the >cluster. > >This add final tests for VM/VMIs, restart/liveMigration and >secondary/primary UDN tests. > >For primary UDN the vmi status do not present the IPs yet so the guest >is inspected, in the future the expected address can be retrieved from >the VMI status for primary UDNs too, although guest will have to be >inspected to ensure that the DHCP/NDP from OVN is working as expected. > >TODO: >- [x] east/west traffic > >Based-on: >- https://github.com/openshift/origin/pull/29186 > >Depends-on: >- https://github.com/openshift/origin/pull/29229 >- https://github.com/kubevirt/containerized-data-importer/pull/3477 >- https://github.com/kubevirt/cluster-network-addons-operator/pull/1922 >- https://github.com/openshift/release/pull/58146 Instructions for interacting with me using PR comments are available [here](https://prow.ci.openshift.org/command-help?repo=openshift%2Forigin). If you have questions or suggestions related to my behavior, please file an issue against the [openshift-eng/jira-lifecycle-plugin](https://github.com/openshift-eng/jira-lifecycle-plugin/issues/new) repository.
qinqon commented 1 month ago

Removed the commit to use origin images so we see the test passing there, we will go back to it when the PR to have them pushed is merged.