cloud-bulldozer / orion

The constellation of a hunter
Apache License 2.0
4 stars 8 forks source link

Junit output #43

Closed shashank-boyapally closed 3 months ago

shashank-boyapally commented 3 months ago

Type of change

Description

Outputs xml format for trt integration. junit file uses the format of trt example junit file. Do not merge until isolation forest PR is merged

(venv) sboyapal orion (junit-output) >> orion cmd --hunter-analyze --output-format='junit' --save-output-path="trt-check.xml" --config="examples/label-small-scale-cluster-density.yaml"
2024-06-24 12:35:53,845 - Orion - INFO - file: orion.py - line: 93 - 🏹 Starting Orion in command-line mode
2024-06-24 12:35:53,847 - Orion - INFO - file: utils.py - line: 212 - The test small-scale-cluster-density-v2 has started
2024-06-24 12:35:53,848 - Matcher - INFO - Executing query against index=ospst-perf-scale-ci-*
2024-06-24 12:35:53,928 - Matcher - INFO - Executing query against index=ospst-perf-scale-ci-*
2024-06-24 12:35:53,960 - Matcher - INFO - Executing query against index=ospst-ripsaw-kube-burner*
2024-06-24 12:35:54,014 - Orion - INFO - file: utils.py - line: 49 - Collecting podReadyLatency
2024-06-24 12:35:54,015 - Matcher - INFO - Executing query against index=ospst-ripsaw-kube-burner*
2024-06-24 12:35:54,065 - Orion - INFO - file: utils.py - line: 49 - Collecting apiserverCPU
2024-06-24 12:35:54,065 - Matcher - INFO - Executing query against index=ospst-ripsaw-kube-burner*
2024-06-24 12:35:54,707 - Orion - INFO - file: utils.py - line: 49 - Collecting ovnCPU
2024-06-24 12:35:54,707 - Matcher - INFO - Executing query against index=ospst-ripsaw-kube-burner*
2024-06-24 12:35:55,551 - Orion - INFO - file: utils.py - line: 49 - Collecting etcdCPU
2024-06-24 12:35:55,551 - Matcher - INFO - Executing query against index=ospst-ripsaw-kube-burner*
2024-06-24 12:35:56,094 - Orion - INFO - file: utils.py - line: 49 - Collecting etcdDisk
2024-06-24 12:35:56,094 - Matcher - INFO - Executing query against index=ospst-ripsaw-kube-burner*
small-scale-cluster-density-v2
==============================
<?xml version="1.0" ?>
<testsuites>
        <testsuite name="small-scale-cluster-density-v2 nightly compare" failures="4">
                <testcase timestamp="1697484328" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/>
                <testcase timestamp="1697484328" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/>
                <testcase timestamp="1697484328" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/>
                <testcase timestamp="1697484328" name="[Jira: etcd] etcdCPU_avg regression detection"/>
                <testcase timestamp="1697484328" name="[Jira: etcd] etcdDisk_avg regression detection"/>
                <testcase timestamp="1697641903" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/>
                <testcase timestamp="1697641903" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/>
                <testcase timestamp="1697641903" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/>
                <testcase timestamp="1697641903" name="[Jira: etcd] etcdCPU_avg regression detection"/>
                <testcase timestamp="1697641903" name="[Jira: etcd] etcdDisk_avg regression detection"/>
                <testcase timestamp="1698144742" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/>
                <testcase timestamp="1698144742" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/>
                <testcase timestamp="1698144742" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/>
                <testcase timestamp="1698144742" name="[Jira: etcd] etcdCPU_avg regression detection"/>
                <testcase timestamp="1698144742" name="[Jira: etcd] etcdDisk_avg regression detection"/>
                <testcase timestamp="1698748202" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/>
                <testcase timestamp="1698748202" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/>
                <testcase timestamp="1698748202" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/>
                <testcase timestamp="1698748202" name="[Jira: etcd] etcdCPU_avg regression detection"/>
                <testcase timestamp="1698748202" name="[Jira: etcd] etcdDisk_avg regression detection"/>
                <testcase timestamp="1698984494" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/>
                <testcase timestamp="1698984494" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/>
                <testcase timestamp="1698984494" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/>
                <testcase timestamp="1698984494" name="[Jira: etcd] etcdCPU_avg regression detection"/>
                <testcase timestamp="1698984494" name="[Jira: etcd] etcdDisk_avg regression detection"/>
                <testcase timestamp="1699352768" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/>
                <testcase timestamp="1699352768" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/>
                <testcase timestamp="1699352768" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/>
                <testcase timestamp="1699352768" name="[Jira: etcd] etcdCPU_avg regression detection"/>
                <testcase timestamp="1699352768" name="[Jira: etcd] etcdDisk_avg regression detection"/>
                <testcase timestamp="1700051798" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/>
                <testcase timestamp="1700051798" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/>
                <testcase timestamp="1700051798" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/>
                <testcase timestamp="1700051798" name="[Jira: etcd] etcdCPU_avg regression detection"/>
                <testcase timestamp="1700051798" name="[Jira: etcd] etcdDisk_avg regression detection"/>
                <testcase timestamp="1700657625" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/>
                <testcase timestamp="1700657625" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/>
                <testcase timestamp="1700657625" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/>
                <testcase timestamp="1700657625" name="[Jira: etcd] etcdCPU_avg regression detection"/>
                <testcase timestamp="1700657625" name="[Jira: etcd] etcdDisk_avg regression detection"/>
                <testcase timestamp="1701261124" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/>
                <testcase timestamp="1701261124" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/>
                <testcase timestamp="1701261124" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/>
                <testcase timestamp="1701261124" name="[Jira: etcd] etcdCPU_avg regression detection"/>
                <testcase timestamp="1701261124" name="[Jira: etcd] etcdDisk_avg regression detection"/>
                <testcase timestamp="1701866097" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/>
                <testcase timestamp="1701866097" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/>
                <testcase timestamp="1701866097" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/>
                <testcase timestamp="1701866097" name="[Jira: etcd] etcdCPU_avg regression detection"/>
                <testcase timestamp="1701866097" name="[Jira: etcd] etcdDisk_avg regression detection"/>
                <testcase timestamp="1703075837" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/>
                <testcase timestamp="1703075837" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/>
                <testcase timestamp="1703075837" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/>
                <testcase timestamp="1703075837" name="[Jira: etcd] etcdCPU_avg regression detection"/>
                <testcase timestamp="1703075837" name="[Jira: etcd] etcdDisk_avg regression detection"/>
                <testcase timestamp="1703680619" name="[Jira: PodLatency] podReadyLatency_P99 regression detection"/>
                <testcase timestamp="1703680619" name="[Jira: kube-apiserver] apiserverCPU_avg regression detection"/>
                <testcase timestamp="1703680619" name="[Jira: ovnKubernetes] ovnCPU_avg regression detection"/>
                <testcase timestamp="1703680619" name="[Jira: etcd] etcdCPU_avg regression detection"/>
                <testcase timestamp="1703680619" name="[Jira: etcd] etcdDisk_avg regression detection">
                        <failure>etcdDisk_avg has a value of 0.02 with a percentage change of 45.55% over the previous runs</failure>
                </testcase> .... truncated

Related Tickets & Documents

Checklist before requesting a review

Testing

shashank-boyapally commented 3 months ago

direction: 1 shows positive changepoints, direction: 0 shows both positive and negative, direction: -1 shows negative changepoints