NO-ISSUE: Automated - Update synthetic test data

openshift-bot commented 3 weeks ago

disruptions Information

There were (58) added jobs and (0) were removed.

Comparisons were above allowed leeway of `30.00%`

Note: For P99, disruptions had 156 jobs increased and 683 jobs decreased.

Click To Show Table

| Name | Release | From | Arch | Network | Platform | Topology | Job Results | P95 | P95 % Increase | P99 | P99 % Increase | | ---- | ------- | ---- | ---- | ------- | -------- |--------- | ----------- | --- | -------------- | --- | -------------- | | ingress-to-console-new-connections | 4.17 | | amd64 | ovn | aws | external | 218 | 10s| 100.00% | 24.98s | 53.82% | ingress-to-console-reused-connections | 4.17 | | amd64 | ovn | aws | external | 218 | 9s| 80.00% | 23.81s | 56.23% | oauth-api-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 8s| 60.00% | 30.54s | 46.83% | kube-api-reused-connections | 4.17 | | amd64 | ovn | vsphere | ha | 731 | 3s| 50.00% | 13.1s | 36.46% | host-to-pod-new-connections | 4.17 | 4.16 | arm64 | ovn | azure | ha | 132 | 3s| 50.00% | 6.38s | 44.02% | metrics-api-reused-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 2s| 100.00% | 2.61s | 30.50% | kube-api-new-connections | 4.18 | 4.17 | amd64 | ovn | azure | ha | 919 | 2s| 100.00% | 6.82s | 70.50% | service-load-balancer-with-pdb-new-connections | 4.18 | 4.17 | heterogeneous | ovn | gcp | ha | 160 | 2s| 100.00% | 4.41s | 45.07% | kube-api-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 1.6s| 60.00% | 4.56s | 36.94% | ingress-to-oauth-server-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | aws | ha | 141 | 0s| 0.00% | 600ms | 71.43% | ingress-to-console-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 0s| 0.00% | 2.83s | 41.50% | ingress-to-console-new-connections | 4.17 | 4.16 | amd64 | ovn | aws | ha | 218 | 1s| 0.00% | 6s | 100.00% | cache-openshift-api-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 154 | 0s| 0.00% | 1.94s | 94.00% | ingress-to-console-new-connections | 4.17 | | heterogeneous | ovn | azure | ha | 131 | 0s| 0.00% | 700ms | 55.56% | image-registry-new-connections | 4.17 | | amd64 | ovn | gcp | ha | 549 | 0s| 0.00% | 2s | 100.00% | oauth-api-new-connections | 4.17 | 4.16 | arm64 | ovn | azure | ha | 132 | 1s| 0.00% | 17.42s | 36.73% | kube-api-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 2s| 0.00% | 13.88s | 44.58% | ingress-to-console-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 138 | 0s| 0.00% | 630ms | 70.27% | host-to-pod-reused-connections | 4.17 | | heterogeneous | ovn | azure | ha | 131 | 0s| 0.00% | 700ms | 55.56% | host-to-host-new-connections | 4.17 | | arm64 | ovn | azure | ha | 120 | 0s| 0.00% | 810ms | 37.29% | cache-kube-api-reused-connections | 4.17 | | amd64 | ovn | vsphere | ha | 731 | 0s| 0.00% | 1s | 66.67% | ingress-to-oauth-server-new-connections | 4.17 | 4.16 | amd64 | ovn | gcp | ha | 205 | 1s| 0.00% | 2s | 39.86% | metrics-api-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 0s| 0.00% | 5.61s | 33.57% | metrics-api-new-connections | 4.17 | | amd64 | ovn | vsphere | ha | 731 | 5s| 0.00% | 13.5s | 40.62% | host-to-host-new-connections | 4.17 | 4.16 | heterogeneous | ovn | gcp | ha | 143 | 0s| 0.00% | 580ms | 75.76% | cache-openshift-api-reused-connections | 4.17 | | amd64 | ovn | gcp | ha | 549 | 0s| 0.00% | 1s | 185.71% | cache-oauth-api-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 138 | 3s| 0.00% | 18s | 45.99% | oauth-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 138 | 3s| 0.00% | 19.63s | 54.57% | openshift-api-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 2s| 0.00% | 20.54s | 71.17% | image-registry-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | aws | ha | 141 | 0s| 0.00% | 4s | 45.45% | host-to-service-new-connections | 4.17 | | heterogeneous | ovn | azure | ha | 131 | 0s| 0.00% | 700ms | 55.56% | image-registry-new-connections | 4.17 | 4.16 | amd64 | ovn | gcp | ha | 205 | 2s| 0.00% | 3.96s | 62.96% | oauth-api-reused-connections | 4.17 | | heterogeneous | ovn | gcp | ha | 135 | 0s| 0.00% | 660ms | 78.38% | ingress-to-console-reused-connections | 4.17 | 4.16 | amd64 | ovn | aws | ha | 218 | 1s| 0.00% | 6s | 500.00% | cache-openshift-api-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 0s| 0.00% | 5.88s | 83.75% | oauth-api-reused-connections | 4.17 | 4.16 | arm64 | ovn | azure | ha | 132 | 2s| 0.00% | 12.97s | 224.25% | kube-api-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 154 | 350ms| 0.00% | 1.94s | 94.00% | cache-oauth-api-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | gcp | ha | 143 | 0s| 0.00% | 580ms | 75.76% | openshift-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 138 | 1.15s| 0.00% | 3.63s | 53.16% | metrics-api-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 154 | 0s| 0.00% | 1.47s | 47.00% | ingress-to-oauth-server-new-connections | 4.17 | | heterogeneous | ovn | azure | ha | 131 | 0s| 0.00% | 700ms | 55.56% | pod-to-service-new-connections | 4.17 | | amd64 | ovn | gcp | ha | 549 | 0s| 0.00% | 520ms | 48.57% | cache-oauth-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 138 | 3s| 0.00% | 18.63s | 51.09% | image-registry-new-connections | 4.17 | 4.17 | amd64 | ovn | aws | ha | 106 | 1s| 0.00% | 2.9s | 190.00% | cache-oauth-api-reused-connections | 4.17 | 4.16 | arm64 | ovn | azure | ha | 132 | 2s| 0.00% | 2.69s | 34.50% | cache-kube-api-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 0s| 0.00% | 5.66s | 117.69% | oauth-api-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 154 | 0s| 0.00% | 1.47s | 47.00% | oauth-api-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 138 | 3s| 0.00% | 18s | 38.89% | kube-api-new-connections | 4.17 | | heterogeneous | ovn | azure | ha | 131 | 0s| 0.00% | 2.4s | 65.52% | metrics-api-new-connections | 4.18 | | amd64 | ovn | gcp | ha | 645 | 0s| 0.00% | 2s | 100.00% | metrics-api-reused-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 1s| 0.00% | 1.99s | 97.03% | ingress-to-console-reused-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 520ms | 372.73% | cache-kube-api-reused-connections | 4.18 | | amd64 | ovn | azure | ha | 502 | 1s| 0.00% | 1.99s | 99.00% | oauth-api-reused-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 1s| 0.00% | 1.99s | 97.03% | host-to-service-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 1s| 0.00% | 18.16s | 100.00% | cache-openshift-api-reused-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 1s| 0.00% | 1.99s | 97.03% | pod-to-service-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 1s| 0.00% | 15.04s | 126.51% | image-registry-new-connections | 4.18 | 4.18 | arm64 | ovn | aws | ha | 103 | 1s| 0.00% | 16.7s | 735.00% | cache-kube-api-new-connections | 4.18 | 4.17 | amd64 | ovn | azure | ha | 919 | 0s| 0.00% | 1s | 1900.00% | ingress-to-oauth-server-new-connections | 4.18 | 4.18 | amd64 | ovn | gcp | ha | 1028 | 1s| 0.00% | 2s | 100.00% | kube-api-reused-connections | 4.18 | | heterogeneous | ovn | azure | ha | 146 | 0s| 0.00% | 2s | 70.94% | kube-api-new-connections | 4.18 | 4.17 | arm64 | ovn | gcp | ha | 145 | 0s| 0.00% | 1.56s | 56.00% | cache-oauth-api-new-connections | 4.18 | 4.17 | heterogeneous | ovn | gcp | ha | 160 | 0s| 0.00% | 410ms | 925.00% | oauth-api-new-connections | 4.18 | 4.17 | amd64 | ovn | azure | ha | 919 | 2s| 0.00% | 7.64s | 52.80% | cache-kube-api-new-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 0s| 0.00% | 1.99s | 97.03% | oauth-api-new-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 0s| 0.00% | 990ms | 9800.00% | host-to-host-reused-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 1m15.92s | 325.56% | openshift-api-new-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 0s| 0.00% | 990ms | 9800.00% | cache-oauth-api-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 520ms | 372.73% | image-registry-reused-connections | 4.18 | 4.17 | arm64 | ovn | gcp | ha | 145 | 1s| 0.00% | 6.92s | 35.69% | oauth-api-new-connections | 4.18 | | arm64 | ovn | gcp | ha | 148 | 0s| 0.00% | 530ms | 152.38% | cache-kube-api-new-connections | 4.18 | | arm64 | ovn | gcp | ha | 148 | 0s| 0.00% | 530ms | 152.38% | cache-oauth-api-reused-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 1s| 0.00% | 1.99s | 97.03% | kube-api-new-connections | 4.18 | | arm64 | ovn | gcp | ha | 148 | 0s| 0.00% | 530ms | 152.38% | host-to-pod-new-connections | 4.18 | 4.18 | amd64 | ovn | aws | single | 435 | 0s| 0.00% | 4.32s | 44.00% | host-to-host-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 1m16.92s | 168.67% | pod-to-pod-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 1m13.32s | 57.14% | cache-oauth-api-reused-connections | 4.18 | | amd64 | ovn | azure | ha | 502 | 1s| 0.00% | 2s | 100.00% | metrics-api-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 27.04s | 96.94% | host-to-pod-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 4.2s| 0.00% | 1m16.16s | 63.61% | ingress-to-console-new-connections | 4.18 | 4.18 | arm64 | ovn | aws | ha | 103 | 1s| 0.00% | 1.98s | 98.00% | cache-openshift-api-new-connections | 4.18 | | arm64 | ovn | gcp | ha | 148 | 0s| 0.00% | 530ms | 152.38% | openshift-api-new-connections | 4.18 | 4.17 | amd64 | ovn | azure | ha | 919 | 2s| 0.00% | 7.82s | 56.40% | openshift-api-reused-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 1s| 0.00% | 2s | 98.02% | image-registry-reused-connections | 4.18 | 4.17 | arm64 | ovn | azure | ha | 140 | 0s| 0.00% | 610ms | 221.05% | host-to-pod-reused-connections | 4.18 | 4.18 | amd64 | ovn | aws | single | 435 | 0s| 0.00% | 4.32s | 44.00% | metrics-api-reused-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 1.6s| 0.00% | 14.96s | 170.52% | host-to-pod-reused-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 1m12.8s | 56.39% | pod-to-host-reused-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 1m16.44s | 372.73% | oauth-api-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 2s| 0.00% | 5.6s | 57.75% | cache-openshift-api-new-connections | 4.18 | 4.17 | amd64 | ovn | azure | ha | 919 | 0s| 0.00% | 1.82s | 82.00% | service-load-balancer-with-pdb-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 4.12s | 148.19% | cache-kube-api-reused-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 1s| 0.00% | 1.99s | 97.03% | kube-api-new-connections | 4.18 | | heterogeneous | ovn | azure | ha | 146 | 0s| 0.00% | 1.65s | 870.59% | kube-api-reused-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 1s| 0.00% | 1.99s | 97.03% | openshift-api-reused-connections | 4.18 | | heterogeneous | ovn | azure | ha | 146 | 0s| 0.00% | 2.1s | 56.72% | pod-to-host-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 1m16.96s | 131.88% | pod-to-pod-reused-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 1m12.8s | 56.39% | pod-to-service-new-connections | 4.18 | 4.17 | arm64 | ovn | azure | ha | 140 | 0s| 0.00% | 1s | 426.32% | cache-kube-api-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 520ms | 372.73% | image-registry-new-connections | 4.18 | 4.18 | amd64 | ovn | gcp | ha | 1028 | 2s| 0.00% | 4s | 33.33%

alerts Information

There were (2878) added jobs and (40) were removed.

Comparisons were above allowed leeway of `30.00%`

Note: For P99, alerts had 43 jobs increased and 268 jobs decreased.

Click To Show Table

| Name | Release | From | Arch | Network | Platform | Topology | Job Results | P95 | P95 % Increase | P99 | P99 % Increase | | ---- | ------- | ---- | ---- | ------- | -------- |--------- | ----------- | --- | -------------- | --- | -------------- | | etcdHighCommitDurations openshift-etcd Warning | 4.18 | 4.17 | amd64 | ovn | azure | ha | 192 | 2m28s| 32.14% | 31m29.22s | 81.36% | NodeSystemSaturation openshift-monitoring Warning | 4.18 | | arm64 | ovn | aws | ha | 129 | 46s| 72.93% | 11m59.2s | 320.34% | NodeSystemSaturation openshift-monitoring Warning | 4.17 | | amd64 | ovn | metal | ha | 213 | 6m55.6s| 0.00% | 25m28s | 379.78% | CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning | 4.17 | | amd64 | ovn | aws | ha | 193 | 2m58s| 0.00% | 11m25.36s | 92.52% | KubeJobFailed openshift-insights Warning | 4.18 | | arm64 | ovn | aws | ha | 129 | 1h40m51.6s| 0.00% | 4h25m59.6s | 34.59% | NodeClockNotSynchronising openshift-monitoring Critical | 4.18 | | amd64 | ovn | metal | ha | 311 | 0s| 0.00% | 4h11m42s | 131.45% | HighOverallControlPlaneCPU openshift-kube-apiserver Warning | 4.18 | | amd64 | ovn | gcp | ha | 156 | 58s| 0.00% | 2m11.5s | 49.43% | CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning | 4.18 | 4.18 | amd64 | ovn | aws | single | 195 | 0s| 0.00% | 2m58s | 53.85% | OperatorHubSourceError openshift-operator-lifecycle-manager Warning | 4.18 | 4.17 | amd64 | ovn | gcp | ha | 227 | 0s| 0.00% | 1m42.4s | 315.58% | NodeSystemSaturation openshift-monitoring Warning | 4.18 | | amd64 | ovn | metal | ha | 311 | 0s| 0.00% | 22m21.4s | 82.45% | KubeAPIErrorBudgetBurn openshift-kube-apiserver Critical | 4.18 | 4.18 | amd64 | ovn | aws | single | 195 | 7m16s| 0.00% | 13m29.6s | 447.03% | KubeletPlegDurationHigh kube-system Warning | 4.18 | | amd64 | ovn | azure | ha | 134 | 0s| 0.00% | 58s | 298.35% | KubeletPlegDurationHigh kube-system Warning | 4.18 | 4.17 | amd64 | ovn | azure | ha | 192 | 0s| 0.00% | 1m3.4s | 126.43% | TargetDown openshift-monitoring Warning | 4.18 | 4.17 | amd64 | ovn | aws | ha | 239 | 0s| 0.00% | 37m22.6s | 58.26% | etcdHighCommitDurations openshift-etcd Warning | 4.18 | | amd64 | ovn | azure | ha | 134 | 0s| 0.00% | 6m35.86s | 349.84% | SystemMemoryExceedsReservation openshift-machine-config-operator Warning | 4.18 | | arm64 | ovn | aws | ha | 129 | 0s| 0.00% | 5m50.64s | 74.59% | ClusterOperatorDown openshift-cluster-version Critical | 4.18 | 4.17 | amd64 | ovn | aws | ha | 239 | 0s| 0.00% | 21m45.4s | 51.07%

/cc @dgoodwin, @neisw, @DennisPeriquet

openshift-ci-robot commented 3 weeks ago

@openshift-bot: This pull request explicitly references no jira issue.

In response to [this](https://github.com/openshift/origin/pull/29255): >## disruptions Information > >There were (`58`) added jobs and (`0`) were removed. > >### Comparisons were above allowed leeway of `30.00%` > >Note: For P99, disruptions had `156` jobs increased and `683` jobs decreased. > >

>

Click To Show Table

> >| Name | Release | From | Arch | Network | Platform | Topology | Job Results | P95 | P95 % Increase | P99 | P99 % Increase | >| ---- | ------- | ---- | ---- | ------- | -------- |--------- | ----------- | --- | -------------- | --- | -------------- | >| ingress-to-console-new-connections | 4.17 | | amd64 | ovn | aws | external | 218 | 10s| 100.00% | 24.98s | 53.82% >| ingress-to-console-reused-connections | 4.17 | | amd64 | ovn | aws | external | 218 | 9s| 80.00% | 23.81s | 56.23% >| oauth-api-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 8s| 60.00% | 30.54s | 46.83% >| kube-api-reused-connections | 4.17 | | amd64 | ovn | vsphere | ha | 731 | 3s| 50.00% | 13.1s | 36.46% >| host-to-pod-new-connections | 4.17 | 4.16 | arm64 | ovn | azure | ha | 132 | 3s| 50.00% | 6.38s | 44.02% >| metrics-api-reused-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 2s| 100.00% | 2.61s | 30.50% >| kube-api-new-connections | 4.18 | 4.17 | amd64 | ovn | azure | ha | 919 | 2s| 100.00% | 6.82s | 70.50% >| service-load-balancer-with-pdb-new-connections | 4.18 | 4.17 | heterogeneous | ovn | gcp | ha | 160 | 2s| 100.00% | 4.41s | 45.07% >| kube-api-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 1.6s| 60.00% | 4.56s | 36.94% >| ingress-to-oauth-server-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | aws | ha | 141 | 0s| 0.00% | 600ms | 71.43% >| ingress-to-console-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 0s| 0.00% | 2.83s | 41.50% >| ingress-to-console-new-connections | 4.17 | 4.16 | amd64 | ovn | aws | ha | 218 | 1s| 0.00% | 6s | 100.00% >| cache-openshift-api-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 154 | 0s| 0.00% | 1.94s | 94.00% >| ingress-to-console-new-connections | 4.17 | | heterogeneous | ovn | azure | ha | 131 | 0s| 0.00% | 700ms | 55.56% >| image-registry-new-connections | 4.17 | | amd64 | ovn | gcp | ha | 549 | 0s| 0.00% | 2s | 100.00% >| oauth-api-new-connections | 4.17 | 4.16 | arm64 | ovn | azure | ha | 132 | 1s| 0.00% | 17.42s | 36.73% >| kube-api-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 2s| 0.00% | 13.88s | 44.58% >| ingress-to-console-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 138 | 0s| 0.00% | 630ms | 70.27% >| host-to-pod-reused-connections | 4.17 | | heterogeneous | ovn | azure | ha | 131 | 0s| 0.00% | 700ms | 55.56% >| host-to-host-new-connections | 4.17 | | arm64 | ovn | azure | ha | 120 | 0s| 0.00% | 810ms | 37.29% >| cache-kube-api-reused-connections | 4.17 | | amd64 | ovn | vsphere | ha | 731 | 0s| 0.00% | 1s | 66.67% >| ingress-to-oauth-server-new-connections | 4.17 | 4.16 | amd64 | ovn | gcp | ha | 205 | 1s| 0.00% | 2s | 39.86% >| metrics-api-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 0s| 0.00% | 5.61s | 33.57% >| metrics-api-new-connections | 4.17 | | amd64 | ovn | vsphere | ha | 731 | 5s| 0.00% | 13.5s | 40.62% >| host-to-host-new-connections | 4.17 | 4.16 | heterogeneous | ovn | gcp | ha | 143 | 0s| 0.00% | 580ms | 75.76% >| cache-openshift-api-reused-connections | 4.17 | | amd64 | ovn | gcp | ha | 549 | 0s| 0.00% | 1s | 185.71% >| cache-oauth-api-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 138 | 3s| 0.00% | 18s | 45.99% >| oauth-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 138 | 3s| 0.00% | 19.63s | 54.57% >| openshift-api-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 2s| 0.00% | 20.54s | 71.17% >| image-registry-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | aws | ha | 141 | 0s| 0.00% | 4s | 45.45% >| host-to-service-new-connections | 4.17 | | heterogeneous | ovn | azure | ha | 131 | 0s| 0.00% | 700ms | 55.56% >| image-registry-new-connections | 4.17 | 4.16 | amd64 | ovn | gcp | ha | 205 | 2s| 0.00% | 3.96s | 62.96% >| oauth-api-reused-connections | 4.17 | | heterogeneous | ovn | gcp | ha | 135 | 0s| 0.00% | 660ms | 78.38% >| ingress-to-console-reused-connections | 4.17 | 4.16 | amd64 | ovn | aws | ha | 218 | 1s| 0.00% | 6s | 500.00% >| cache-openshift-api-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 0s| 0.00% | 5.88s | 83.75% >| oauth-api-reused-connections | 4.17 | 4.16 | arm64 | ovn | azure | ha | 132 | 2s| 0.00% | 12.97s | 224.25% >| kube-api-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 154 | 350ms| 0.00% | 1.94s | 94.00% >| cache-oauth-api-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | gcp | ha | 143 | 0s| 0.00% | 580ms | 75.76% >| openshift-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 138 | 1.15s| 0.00% | 3.63s | 53.16% >| metrics-api-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 154 | 0s| 0.00% | 1.47s | 47.00% >| ingress-to-oauth-server-new-connections | 4.17 | | heterogeneous | ovn | azure | ha | 131 | 0s| 0.00% | 700ms | 55.56% >| pod-to-service-new-connections | 4.17 | | amd64 | ovn | gcp | ha | 549 | 0s| 0.00% | 520ms | 48.57% >| cache-oauth-api-new-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 138 | 3s| 0.00% | 18.63s | 51.09% >| image-registry-new-connections | 4.17 | 4.17 | amd64 | ovn | aws | ha | 106 | 1s| 0.00% | 2.9s | 190.00% >| cache-oauth-api-reused-connections | 4.17 | 4.16 | arm64 | ovn | azure | ha | 132 | 2s| 0.00% | 2.69s | 34.50% >| cache-kube-api-new-connections | 4.17 | 4.16 | amd64 | ovn | azure | ha | 140 | 0s| 0.00% | 5.66s | 117.69% >| oauth-api-new-connections | 4.17 | 4.17 | amd64 | ovn | gcp | ha | 154 | 0s| 0.00% | 1.47s | 47.00% >| oauth-api-reused-connections | 4.17 | 4.16 | heterogeneous | ovn | azure | ha | 138 | 3s| 0.00% | 18s | 38.89% >| kube-api-new-connections | 4.17 | | heterogeneous | ovn | azure | ha | 131 | 0s| 0.00% | 2.4s | 65.52% >| metrics-api-new-connections | 4.18 | | amd64 | ovn | gcp | ha | 645 | 0s| 0.00% | 2s | 100.00% >| metrics-api-reused-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 1s| 0.00% | 1.99s | 97.03% >| ingress-to-console-reused-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 520ms | 372.73% >| cache-kube-api-reused-connections | 4.18 | | amd64 | ovn | azure | ha | 502 | 1s| 0.00% | 1.99s | 99.00% >| oauth-api-reused-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 1s| 0.00% | 1.99s | 97.03% >| host-to-service-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 1s| 0.00% | 18.16s | 100.00% >| cache-openshift-api-reused-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 1s| 0.00% | 1.99s | 97.03% >| pod-to-service-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 1s| 0.00% | 15.04s | 126.51% >| image-registry-new-connections | 4.18 | 4.18 | arm64 | ovn | aws | ha | 103 | 1s| 0.00% | 16.7s | 735.00% >| cache-kube-api-new-connections | 4.18 | 4.17 | amd64 | ovn | azure | ha | 919 | 0s| 0.00% | 1s | 1900.00% >| ingress-to-oauth-server-new-connections | 4.18 | 4.18 | amd64 | ovn | gcp | ha | 1028 | 1s| 0.00% | 2s | 100.00% >| kube-api-reused-connections | 4.18 | | heterogeneous | ovn | azure | ha | 146 | 0s| 0.00% | 2s | 70.94% >| kube-api-new-connections | 4.18 | 4.17 | arm64 | ovn | gcp | ha | 145 | 0s| 0.00% | 1.56s | 56.00% >| cache-oauth-api-new-connections | 4.18 | 4.17 | heterogeneous | ovn | gcp | ha | 160 | 0s| 0.00% | 410ms | 925.00% >| oauth-api-new-connections | 4.18 | 4.17 | amd64 | ovn | azure | ha | 919 | 2s| 0.00% | 7.64s | 52.80% >| cache-kube-api-new-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 0s| 0.00% | 1.99s | 97.03% >| oauth-api-new-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 0s| 0.00% | 990ms | 9800.00% >| host-to-host-reused-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 1m15.92s | 325.56% >| openshift-api-new-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 0s| 0.00% | 990ms | 9800.00% >| cache-oauth-api-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 520ms | 372.73% >| image-registry-reused-connections | 4.18 | 4.17 | arm64 | ovn | gcp | ha | 145 | 1s| 0.00% | 6.92s | 35.69% >| oauth-api-new-connections | 4.18 | | arm64 | ovn | gcp | ha | 148 | 0s| 0.00% | 530ms | 152.38% >| cache-kube-api-new-connections | 4.18 | | arm64 | ovn | gcp | ha | 148 | 0s| 0.00% | 530ms | 152.38% >| cache-oauth-api-reused-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 1s| 0.00% | 1.99s | 97.03% >| kube-api-new-connections | 4.18 | | arm64 | ovn | gcp | ha | 148 | 0s| 0.00% | 530ms | 152.38% >| host-to-pod-new-connections | 4.18 | 4.18 | amd64 | ovn | aws | single | 435 | 0s| 0.00% | 4.32s | 44.00% >| host-to-host-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 1m16.92s | 168.67% >| pod-to-pod-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 1m13.32s | 57.14% >| cache-oauth-api-reused-connections | 4.18 | | amd64 | ovn | azure | ha | 502 | 1s| 0.00% | 2s | 100.00% >| metrics-api-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 27.04s | 96.94% >| host-to-pod-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 4.2s| 0.00% | 1m16.16s | 63.61% >| ingress-to-console-new-connections | 4.18 | 4.18 | arm64 | ovn | aws | ha | 103 | 1s| 0.00% | 1.98s | 98.00% >| cache-openshift-api-new-connections | 4.18 | | arm64 | ovn | gcp | ha | 148 | 0s| 0.00% | 530ms | 152.38% >| openshift-api-new-connections | 4.18 | 4.17 | amd64 | ovn | azure | ha | 919 | 2s| 0.00% | 7.82s | 56.40% >| openshift-api-reused-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 1s| 0.00% | 2s | 98.02% >| image-registry-reused-connections | 4.18 | 4.17 | arm64 | ovn | azure | ha | 140 | 0s| 0.00% | 610ms | 221.05% >| host-to-pod-reused-connections | 4.18 | 4.18 | amd64 | ovn | aws | single | 435 | 0s| 0.00% | 4.32s | 44.00% >| metrics-api-reused-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 1.6s| 0.00% | 14.96s | 170.52% >| host-to-pod-reused-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 1m12.8s | 56.39% >| pod-to-host-reused-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 1m16.44s | 372.73% >| oauth-api-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 2s| 0.00% | 5.6s | 57.75% >| cache-openshift-api-new-connections | 4.18 | 4.17 | amd64 | ovn | azure | ha | 919 | 0s| 0.00% | 1.82s | 82.00% >| service-load-balancer-with-pdb-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 4.12s | 148.19% >| cache-kube-api-reused-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 1s| 0.00% | 1.99s | 97.03% >| kube-api-new-connections | 4.18 | | heterogeneous | ovn | azure | ha | 146 | 0s| 0.00% | 1.65s | 870.59% >| kube-api-reused-connections | 4.18 | | amd64 | ovn | metal | compact | 102 | 1s| 0.00% | 1.99s | 97.03% >| openshift-api-reused-connections | 4.18 | | heterogeneous | ovn | azure | ha | 146 | 0s| 0.00% | 2.1s | 56.72% >| pod-to-host-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 1m16.96s | 131.88% >| pod-to-pod-reused-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 1m12.8s | 56.39% >| pod-to-service-new-connections | 4.18 | 4.17 | arm64 | ovn | azure | ha | 140 | 0s| 0.00% | 1s | 426.32% >| cache-kube-api-new-connections | 4.18 | 4.17 | heterogeneous | ovn | azure | ha | 149 | 0s| 0.00% | 520ms | 372.73% >| image-registry-new-connections | 4.18 | 4.18 | amd64 | ovn | gcp | ha | 1028 | 2s| 0.00% | 4s | 33.33% > > >

alerts Information

There were (2878) added jobs and (40) were removed.

Comparisons were above allowed leeway of 30.00%

Note: For P99, alerts had 43 jobs increased and 268 jobs decreased.

Click To Show Table
| Name | Release | From | Arch | Network | Platform | Topology | Job Results | P95 | P95 % Increase | P99 | P99 % Increase | | ---- | ------- | ---- | ---- | ------- | -------- |--------- | ----------- | --- | -------------- | --- | -------------- | | etcdHighCommitDurations openshift-etcd Warning | 4.18 | 4.17 | amd64 | ovn | azure | ha | 192 | 2m28s| 32.14% | 31m29.22s | 81.36% | NodeSystemSaturation openshift-monitoring Warning | 4.18 | | arm64 | ovn | aws | ha | 129 | 46s| 72.93% | 11m59.2s | 320.34% | NodeSystemSaturation openshift-monitoring Warning | 4.17 | | amd64 | ovn | metal | ha | 213 | 6m55.6s| 0.00% | 25m28s | 379.78% | CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning | 4.17 | | amd64 | ovn | aws | ha | 193 | 2m58s| 0.00% | 11m25.36s | 92.52% | KubeJobFailed openshift-insights Warning | 4.18 | | arm64 | ovn | aws | ha | 129 | 1h40m51.6s| 0.00% | 4h25m59.6s | 34.59% | NodeClockNotSynchronising openshift-monitoring Critical | 4.18 | | amd64 | ovn | metal | ha | 311 | 0s| 0.00% | 4h11m42s | 131.45% | HighOverallControlPlaneCPU openshift-kube-apiserver Warning | 4.18 | | amd64 | ovn | gcp | ha | 156 | 58s| 0.00% | 2m11.5s | 49.43% | CsvAbnormalFailedOver2Min openshift-operator-lifecycle-manager Warning | 4.18 | 4.18 | amd64 | ovn | aws | single | 195 | 0s| 0.00% | 2m58s | 53.85% | OperatorHubSourceError openshift-operator-lifecycle-manager Warning | 4.18 | 4.17 | amd64 | ovn | gcp | ha | 227 | 0s| 0.00% | 1m42.4s | 315.58% | NodeSystemSaturation openshift-monitoring Warning | 4.18 | | amd64 | ovn | metal | ha | 311 | 0s| 0.00% | 22m21.4s | 82.45% | KubeAPIErrorBudgetBurn openshift-kube-apiserver Critical | 4.18 | 4.18 | amd64 | ovn | aws | single | 195 | 7m16s| 0.00% | 13m29.6s | 447.03% | KubeletPlegDurationHigh kube-system Warning | 4.18 | | amd64 | ovn | azure | ha | 134 | 0s| 0.00% | 58s | 298.35% | KubeletPlegDurationHigh kube-system Warning | 4.18 | 4.17 | amd64 | ovn | azure | ha | 192 | 0s| 0.00% | 1m3.4s | 126.43% | TargetDown openshift-monitoring Warning | 4.18 | 4.17 | amd64 | ovn | aws | ha | 239 | 0s| 0.00% | 37m22.6s | 58.26% | etcdHighCommitDurations openshift-etcd Warning | 4.18 | | amd64 | ovn | azure | ha | 134 | 0s| 0.00% | 6m35.86s | 349.84% | SystemMemoryExceedsReservation openshift-machine-config-operator Warning | 4.18 | | arm64 | ovn | aws | ha | 129 | 0s| 0.00% | 5m50.64s | 74.59% | ClusterOperatorDown openshift-cluster-version Critical | 4.18 | 4.17 | amd64 | ovn | aws | ha | 239 | 0s| 0.00% | 21m45.4s | 51.07%

/cc @dgoodwin, @neisw, @DennisPeriquet

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

neisw commented 3 weeks ago

/lgtm

openshift-ci[bot] commented 3 weeks ago

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: neisw, openshift-bot

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files: - ~~[OWNERS](https://github.com/openshift/origin/blob/master/OWNERS)~~ [neisw] Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment

openshift-ci[bot] commented 3 weeks ago

@openshift-bot: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/e2e-metal-ipi-ovn	c744c5d6721feaf0f16b026eb258808dbee0a6e4	link	false	`/test e2e-metal-ipi-ovn`
ci/prow/e2e-aws-ovn-upgrade	c744c5d6721feaf0f16b026eb258808dbee0a6e4	link	false	`/test e2e-aws-ovn-upgrade`
ci/prow/e2e-aws-ovn-single-node-upgrade	c744c5d6721feaf0f16b026eb258808dbee0a6e4	link	false	`/test e2e-aws-ovn-single-node-upgrade`

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes-sigs/prow](https://github.com/kubernetes-sigs/prow/issues/new?title=Prow%20issue:) repository. I understand the commands that are listed [here](https://go.k8s.io/bot-commands).

openshift-trt-bot commented 3 weeks ago

Job Failure Risk Analysis for sha: c744c5d6721feaf0f16b026eb258808dbee0a6e4

Job Name	Failure Risk
pull-ci-openshift-origin-master-e2e-aws-ovn-serial	Medium [bz-openshift-apiserver] clusteroperator/openshift-apiserver should not change condition/Available This test has passed 92.29% of 5976 runs on release 4.18 [Overall] in the last week.

openshift-ci-robot commented 3 weeks ago

/retest-required

Remaining retests: 0 against base HEAD 6ad5125c8f320c450077ab02204f2ee061be9092 and 2 for PR HEAD c744c5d6721feaf0f16b026eb258808dbee0a6e4 in total

openshift-bot commented 2 weeks ago

[ART PR BUILD NOTIFIER]

Distgit: openshift-enterprise-tests This PR has been included in build openshift-enterprise-tests-container-v4.18.0-202411050638.p0.gcc7fd60.assembly.stream.el9. All builds following this will include this PR.

openshift / origin