Closed shashank-boyapally closed 3 months ago
Outputs xml format for trt integration. junit file uses the format of trt example junit file. Do not merge until isolation forest PR is merged
(venv) sboyapal orion (junit-output) >> orion cmd --hunter-analyze --output-format='junit' --save-output-path="trt-check.xml" --config="examples/label-small-scale-cluster-density.yaml" 2024-06-24 12:35:53,845 - Orion - INFO - file: orion.py - line: 93 - 🏹 Starting Orion in command-line mode 2024-06-24 12:35:53,847 - Orion - INFO - file: utils.py - line: 212 - The test small-scale-cluster-density-v2 has started 2024-06-24 12:35:53,848 - Matcher - INFO - Executing query against index=ospst-perf-scale-ci-* 2024-06-24 12:35:53,928 - Matcher - INFO - Executing query against index=ospst-perf-scale-ci-* 2024-06-24 12:35:53,960 - Matcher - INFO - Executing query against index=ospst-ripsaw-kube-burner* 2024-06-24 12:35:54,014 - Orion - INFO - file: utils.py - line: 49 - Collecting podReadyLatency 2024-06-24 12:35:54,015 - Matcher - INFO - Executing query against index=ospst-ripsaw-kube-burner* 2024-06-24 12:35:54,065 - Orion - INFO - file: utils.py - line: 49 - Collecting apiserverCPU 2024-06-24 12:35:54,065 - Matcher - INFO - Executing query against index=ospst-ripsaw-kube-burner* 2024-06-24 12:35:54,707 - Orion - INFO - file: utils.py - line: 49 - Collecting ovnCPU 2024-06-24 12:35:54,707 - Matcher - INFO - Executing query against index=ospst-ripsaw-kube-burner* 2024-06-24 12:35:55,551 - Orion - INFO - file: utils.py - line: 49 - Collecting etcdCPU 2024-06-24 12:35:55,551 - Matcher - INFO - Executing query against index=ospst-ripsaw-kube-burner* 2024-06-24 12:35:56,094 - Orion - INFO - file: utils.py - line: 49 - Collecting etcdDisk 2024-06-24 12:35:56,094 - Matcher - INFO - Executing query against index=ospst-ripsaw-kube-burner* small-scale-cluster-density-v2 ============================== <?xml version="1.0" ?> <testsuites> <testsuite name="small-scale-cluster-density-v2 nightly compare" failures="4"> <testcase timestamp="1697484328" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/> <testcase timestamp="1697484328" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/> <testcase timestamp="1697484328" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/> <testcase timestamp="1697484328" name="[Jira: etcd] etcdCPU_avg regression detection"/> <testcase timestamp="1697484328" name="[Jira: etcd] etcdDisk_avg regression detection"/> <testcase timestamp="1697641903" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/> <testcase timestamp="1697641903" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/> <testcase timestamp="1697641903" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/> <testcase timestamp="1697641903" name="[Jira: etcd] etcdCPU_avg regression detection"/> <testcase timestamp="1697641903" name="[Jira: etcd] etcdDisk_avg regression detection"/> <testcase timestamp="1698144742" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/> <testcase timestamp="1698144742" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/> <testcase timestamp="1698144742" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/> <testcase timestamp="1698144742" name="[Jira: etcd] etcdCPU_avg regression detection"/> <testcase timestamp="1698144742" name="[Jira: etcd] etcdDisk_avg regression detection"/> <testcase timestamp="1698748202" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/> <testcase timestamp="1698748202" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/> <testcase timestamp="1698748202" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/> <testcase timestamp="1698748202" name="[Jira: etcd] etcdCPU_avg regression detection"/> <testcase timestamp="1698748202" name="[Jira: etcd] etcdDisk_avg regression detection"/> <testcase timestamp="1698984494" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/> <testcase timestamp="1698984494" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/> <testcase timestamp="1698984494" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/> <testcase timestamp="1698984494" name="[Jira: etcd] etcdCPU_avg regression detection"/> <testcase timestamp="1698984494" name="[Jira: etcd] etcdDisk_avg regression detection"/> <testcase timestamp="1699352768" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/> <testcase timestamp="1699352768" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/> <testcase timestamp="1699352768" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/> <testcase timestamp="1699352768" name="[Jira: etcd] etcdCPU_avg regression detection"/> <testcase timestamp="1699352768" name="[Jira: etcd] etcdDisk_avg regression detection"/> <testcase timestamp="1700051798" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/> <testcase timestamp="1700051798" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/> <testcase timestamp="1700051798" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/> <testcase timestamp="1700051798" name="[Jira: etcd] etcdCPU_avg regression detection"/> <testcase timestamp="1700051798" name="[Jira: etcd] etcdDisk_avg regression detection"/> <testcase timestamp="1700657625" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/> <testcase timestamp="1700657625" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/> <testcase timestamp="1700657625" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/> <testcase timestamp="1700657625" name="[Jira: etcd] etcdCPU_avg regression detection"/> <testcase timestamp="1700657625" name="[Jira: etcd] etcdDisk_avg regression detection"/> <testcase timestamp="1701261124" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/> <testcase timestamp="1701261124" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/> <testcase timestamp="1701261124" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/> <testcase timestamp="1701261124" name="[Jira: etcd] etcdCPU_avg regression detection"/> <testcase timestamp="1701261124" name="[Jira: etcd] etcdDisk_avg regression detection"/> <testcase timestamp="1701866097" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/> <testcase timestamp="1701866097" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/> <testcase timestamp="1701866097" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/> <testcase timestamp="1701866097" name="[Jira: etcd] etcdCPU_avg regression detection"/> <testcase timestamp="1701866097" name="[Jira: etcd] etcdDisk_avg regression detection"/> <testcase timestamp="1703075837" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/> <testcase timestamp="1703075837" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/> <testcase timestamp="1703075837" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/> <testcase timestamp="1703075837" name="[Jira: etcd] etcdCPU_avg regression detection"/> <testcase timestamp="1703075837" name="[Jira: etcd] etcdDisk_avg regression detection"/> <testcase timestamp="1703680619" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/> <testcase timestamp="1703680619" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/> <testcase timestamp="1703680619" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/> <testcase timestamp="1703680619" name="[Jira: etcd] etcdCPU_avg regression detection"/> <testcase timestamp="1703680619" name="[Jira: etcd] etcdDisk_avg regression detection"> <failure>etcdDisk_avg has a value of 0.02 with a percentage change of 45.55% over the previous runs</failure> </testcase> .... truncated
direction: 1 shows positive changepoints, direction: 0 shows both positive and negative, direction: -1 shows negative changepoints
direction: 1
direction: 0
direction: -1
Type of change
Description
Outputs xml format for trt integration. junit file uses the format of trt example junit file. Do not merge until isolation forest PR is merged
Related Tickets & Documents
Checklist before requesting a review
Testing