openshift / svt

Apache License 2.0
123 stars 105 forks source link

OCPQE 12814 NetworkPolicy scalability #750

Closed lenahorsley closed 1 year ago

lenahorsley commented 1 year ago

kube-burner test: https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/scale-ci/job/e2e-benchmarking-multibranch-pipeline/job/regression-test/240/console

@paigerube14 @qiliRedHat

lenahorsley commented 1 year ago

https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/scale-ci/job/e2e-benchmarking-multibranch-pipeline/job/regression-test/243/console

@paigerube14 @qiliRedHat

qiliRedHat commented 1 year ago

@lenahorsley

  1. Could you manage to add the logic of network policy active and in active time evaluation in your new script to cover step 5.1 - 5.4? You can refer to my previous script. https://github.com/openshift/svt/blob/3f6e35284a665c4e0a7cff409943dd66739fc153/openshift_scalability/scripts/network_policy_scalability.sh#L101-L121
  2. Let's output and add a verification that (($final_time_np - $final_time_no_np)) is less than a number. You can refer to the previous test results in the test case to give a number. We can adjust it in the later tests.
lenahorsley commented 1 year ago

@qiliRedHat @paigerube14 Here's the Jenkins job: https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/scale-ci/job/e2e-benchmarking-multibranch-pipeline/job/regression-test/251/console

lenahorsley commented 1 year ago

@paigerube14 @qiliRedHat https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/scale-ci/job/e2e-benchmarking-multibranch-pipeline/job/regression-test/257/console

lenahorsley commented 1 year ago

@paigerube14 @qiliRedHat there are no changes to the PR. This is a new Jenkins job (the previous one will be removed soon).

https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/scale-ci/job/e2e-benchmarking-multibranch-pipeline/job/regression-test/269/console

lenahorsley commented 1 year ago

@paigerube14 @qiliRedHat

https://mastern-jenkins-csb-openshift-qe.apps.ocp-c1.prod.psi.redhat.com/job/scale-ci/job/e2e-benchmarking-multibranch-pipeline/job/regression-test/270/console

qiliRedHat commented 1 year ago

/lgtm