Regression enhancement networkpolicy

[qiliRedHat]

OCP-26279 - [BZ 1752636] Networkpolicy should be applied for large namespaces https://polarion.engineering.redhat.com/polarion/redirect/project/OSE/workitem?id=OCP-26279

https://issues.redhat.com/browse/OCPQE-11379 Add kube-burner config to replace cluster-loader Update script, remove cluster-loader, add assertion

[qiliRedHat]

Manual test bube-burner config, with 3 projects

# INDEXING=false WORKLOAD_TEMPLATE=/root/git/svt/perfscale_regerssion_ci/kubeburner-object-templates/pause-config.yml WORKLOAD=custom ./run.sh
Thu Jul 28 09:22:25 AM UTC 2022 creating python virtual environment at path: /tmp/5ab6f906-8845-432f-a3d9-9ae1480040e5/ripsaw-cli
Installing Operator from repo https://github.com/cloud-bulldozer/benchmark-operator.git and branch master
ripsaw-cli:ripsaw.clients.k8s:INFO :: benchmark-operator    benchmark-controller-manager-844dcdff69-sd7fg   Running
Operator Running
###############################################
Workload: custom
Workload template: /root/git/svt/perfscale_regerssion_ci/kubeburner-object-templates/pause-config.yml
Metrics profile: 
Alerts profile: 
QPS: 50
Burst: 50
UUID: 5ab6f906-8845-432f-a3d9-9ae1480040e5
Job iterations: 
###############################################
Thu Jul 28 09:22:55 AM UTC 2022 Creating kube-burner configmap
configmap/kube-burner-cfg-5ab6f906-8845-432f-a3d9-9ae1480040e5 created
Thu Jul 28 09:22:55 AM UTC 2022 Deploying benchmark
Starting Benchmark kube-burner-custom-5ab6f906-8845-432f-a3d9-9ae1480040e5, timeout set to 15000 seconds
ripsaw-cli:ripsaw.models.benchmark:INFO :: Benchmark kube-burner-custom-5ab6f906-8845-432f-a3d9-9ae1480040e5 created
ripsaw-cli:ripsaw.clients.k8s:INFO :: Waiting for state: Complete
ripsaw-cli:ripsaw.clients.k8s:INFO :: BENCHMARK UUID                    STATE
ripsaw-cli:ripsaw.clients.k8s:INFO :: kube-burner-custom-5ab6f906-8845-432f-a3d9-9ae1480040e5   Not Assigned Yet    
ripsaw-cli:ripsaw.clients.k8s:INFO :: kube-burner-custom-5ab6f906-8845-432f-a3d9-9ae1480040e5   5ab6f906-8845-432f-a3d9-9ae1480040e5    
ripsaw-cli:ripsaw.clients.k8s:INFO :: kube-burner-custom-5ab6f906-8845-432f-a3d9-9ae1480040e5   5ab6f906-8845-432f-a3d9-9ae1480040e5    Building
ripsaw-cli:ripsaw.clients.k8s:INFO :: kube-burner-custom-5ab6f906-8845-432f-a3d9-9ae1480040e5   5ab6f906-8845-432f-a3d9-9ae1480040e5    Running
ripsaw-cli:ripsaw.clients.k8s:INFO :: kube-burner-custom-5ab6f906-8845-432f-a3d9-9ae1480040e5   5ab6f906-8845-432f-a3d9-9ae1480040e5    Complete
ripsaw-cli:ripsaw.clients.k8s:INFO :: kube-burner-custom-5ab6f906-8845-432f-a3d9-9ae1480040e5 with uuid 5ab6f906-8845-432f-a3d9-9ae1480040e5 has reached the desired state Complete
Benchmark kube-burner-custom-5ab6f906-8845-432f-a3d9-9ae1480040e5 Complete
Run Metadata: 
{
    "name": "kube-burner-custom-5ab6f906-8845-432f-a3d9-9ae1480040e5",
    "namespace": "benchmark-operator",
    "uuid": "5ab6f906-8845-432f-a3d9-9ae1480040e5",
    "suuid": "5ab6f906",
    "status": "Complete"
}

Thu Jul 28 09:23:41 AM UTC 2022 Indexing benchmark metadata to https://search-perfscale-dev-chmf5l4sh66lvxbnadi4bznl3a.us-west-2.es.amazonaws.com:443/ripsaw-kube-burner
Thu Jul 28 09:23:41 AM UTC 2022 deactivating python virtual environment at path: /tmp/5ab6f906-8845-432f-a3d9-9ae1480040e5/ripsaw-cli
Thu Jul 28 09:23:41 AM UTC 2022 cleaning up unique run directory at path: /tmp/5ab6f906-8845-432f-a3d9-9ae1480040e5
(scale-ci) [root@ip-172-31-4-188 kube-burner]# oc get ns | grep large-network-policy
large-network-policy-1                             Active   3m32s
large-network-policy-2                             Active   3m32s
large-network-policy-3                             Active   3m32s
(scale-ci) [root@ip-172-31-4-188 kube-burner]# oc get all -n large-network-policy-1
NAME                             READY   STATUS    RESTARTS   AGE
pod/pause-1-1-7f7d5467b7-psvhn   1/1     Running   0          3m37s

NAME                TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)   AGE
service/pause-1-1   ClusterIP   172.30.200.100   <none>        80/TCP    3m37s

NAME                        READY   UP-TO-DATE   AVAILABLE   AGE
deployment.apps/pause-1-1   1/1     1            1           3m37s

NAME                                   DESIRED   CURRENT   READY   AGE
replicaset.apps/pause-1-1-7f7d5467b7   1         1         1       3m37s

[qiliRedHat]

@paigerube14 PTAL

[paigerube14]

Talked with Qiujie offline and we decided it would be good to have a common script to clone the e2e-benchmark repo and do the ./run.sh (and needs to cd to the correct folder, can probably hard code to workload/kube-burner for now). Want to keep this as simple and robust as possible to be able to pass any file/object configuration in the future. With keeping it robust, we will want to set all the environment variables in the specific test run script, this includes the type of workload (will be custom in almost all cases).

INDEXING=false WORKLOAD_TEMPLATE=my-config/kube-burner.cfg METRICS_PROFILE=my-metrics/metrics.yml ALERTS_PROFILE=my-alerts/alerts-profile.yml WORKLOAD=custom (etc)

[qiliRedHat]

@paigerube14 I updated based on what we talked yesterday. Please take a look again.

[nathan-weinberg]

/cc @nathan-weinberg

[nathan-weinberg]

@qiliRedHat couple small things:

1. perfscale_regerssion_ci needs to be fixed to perfscale_regression_ci
2. Can you add newlines to the end of these files?

[qiliRedHat]

@qiliRedHat couple small things:

1. perfscale_regerssion_ci needs to be fixed to perfscale_regression_ci
2. Can you add newlines to the end of these files?

@nathan-weinberg Done

[qiliRedHat]

@paigerube14 I updated based on the above comments. Please take a look again.

[paigerube14]

/lgtm

[paigerube14]

/lgtm