Open paigerube14 opened 1 year ago
To be able to compare among runs we need more common data metrics/points to compare against. The config files needed to have buckets that will be consistent among the tests we will compare amongst (pod/container names change every run)
These files help be able to compare between runs of the same job type and give a proper output. Need to further work on the tolerancy and max_failures of the tolerancy_configs but have data being able to be compared properly: See passing job here: https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/scale-ci/job/paige-e2e-multibranch/job/benchmark-comparison/105/console
Description
To be able to compare among runs we need more common data metrics/points to compare against. The config files needed to have buckets that will be consistent among the tests we will compare amongst (pod/container names change every run)
These files help be able to compare between runs of the same job type and give a proper output. Need to further work on the tolerancy and max_failures of the tolerancy_configs but have data being able to be compared properly: See passing job here: https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/scale-ci/job/paige-e2e-multibranch/job/benchmark-comparison/105/console