cloud-bulldozer / k8s-netperf

Running Networking Performance Tests against K8s
Apache License 2.0
28 stars 18 forks source link

Integrating GO tablewriter for output formatting #49

Closed vishnuchalla closed 1 year ago

vishnuchalla commented 1 year ago

Description

Suggesting table writer for output logging to avoid overhead with format specifiers. There are more useful options which might be worth exploring for our future releases.

Testing

Tested with new formatting.

INFO[2023-03-30 23:43:19] šŸ“’ Reading netperf.yml file.                  
INFO[2023-03-30 23:43:20] šŸ”¬ openshift-monitoring namespace found       
WARN[2023-03-30 23:43:22] āš ļø  Single node per zone                     
INFO[2023-03-30 23:43:22] Deploying in us-west-2c zone                 
INFO[2023-03-30 23:43:22] ā™»ļø  Using existing Service                   
INFO[2023-03-30 23:43:22] ā™»ļø  Using existing Deployment                
INFO[2023-03-30 23:43:22] ā° Checking for Pods to become ready...       
INFO[2023-03-30 23:43:23] ā™»ļø  Using existing Deployment                
INFO[2023-03-30 23:43:23] ā° Checking for Pods to become ready...       
INFO[2023-03-30 23:43:24] šŸ—’ļø  Running netperf TCP_STREAM (service false) for 10s 
INFO[2023-03-30 23:43:37] šŸ—’ļø  Running netperf TCP_STREAM (service false) for 10s 
INFO[2023-03-30 23:43:50] šŸ—’ļø  Running netperf TCP_STREAM (service false) for 10s 
INFO[2023-03-30 23:44:03] šŸ—’ļø  Running netperf TCP_STREAM (service false) for 10s 
INFO[2023-03-30 23:44:16] šŸ—’ļø  Running netperf TCP_STREAM (service false) for 10s 
INFO[2023-03-30 23:44:29] šŸ—’ļø  Running netperf TCP_STREAM (service false) for 10s 
INFO[2023-03-30 23:44:43] šŸ—’ļø  Running netperf UDP_STREAM (service false) for 10s 
INFO[2023-03-30 23:44:56] šŸ—’ļø  Running netperf UDP_STREAM (service false) for 10s 
INFO[2023-03-30 23:45:09] šŸ—’ļø  Running netperf UDP_STREAM (service false) for 10s 
INFO[2023-03-30 23:45:22] šŸ—’ļø  Running netperf TCP_CRR (service false) for 10s 
INFO[2023-03-30 23:45:37] šŸ—’ļø  Running netperf TCP_CRR (service false) for 10s 
INFO[2023-03-30 23:45:52] šŸ—’ļø  Running netperf TCP_CRR (service false) for 10s 
INFO[2023-03-30 23:46:07] šŸ—’ļø  Running netperf TCP_CRR (service true) for 10s 
INFO[2023-03-30 23:46:23] šŸ—’ļø  Running netperf TCP_CRR (service true) for 10s 
INFO[2023-03-30 23:46:38] šŸ—’ļø  Running netperf TCP_CRR (service true) for 10s 
INFO[2023-03-30 23:46:53] šŸ—’ļø  Running netperf TCP_RR (service false) for 10s 
INFO[2023-03-30 23:47:06] šŸ—’ļø  Running netperf TCP_RR (service false) for 10s 
INFO[2023-03-30 23:47:19] šŸ—’ļø  Running netperf TCP_RR (service false) for 10s 
+----------------+------------+-------------+--------------+---------+--------------+-----------+----------+---------+--------------------+
|  RESULT TYPE   |  SCENARIO  | PARALLELISM | HOST NETWORK | SERVICE | MESSAGE SIZE | SAME NODE | DURATION | SAMPLES |     AVG VALUE      |
+----------------+------------+-------------+--------------+---------+--------------+-----------+----------+---------+--------------------+
| Stream Results | TCP_STREAM | 1           | false        | false   | 1024         | false     | 10       | 3       | 4890.580000 (Mb/s) |
| Stream Results | TCP_STREAM | 1           | false        | false   | 8192         | false     | 10       | 3       | 4926.630000 (Mb/s) |
| Stream Results | UDP_STREAM | 1           | false        | false   | 1024         | false     | 10       | 3       | 1574.320000 (Mb/s) |
+----------------+------------+-------------+--------------+---------+--------------+-----------+----------+---------+--------------------+
+-------------+----------+-------------+--------------+---------+--------------+-----------+----------+---------+--------------------+
| RESULT TYPE | SCENARIO | PARALLELISM | HOST NETWORK | SERVICE | MESSAGE SIZE | SAME NODE | DURATION | SAMPLES |     AVG VALUE      |
+-------------+----------+-------------+--------------+---------+--------------+-----------+----------+---------+--------------------+
| Rr Results  | TCP_CRR  | 1           | false        | false   | 1024         | false     | 10       | 3       | 1509.090000 (OP/s) |
| Rr Results  | TCP_CRR  | 1           | false        | true    | 1024         | false     | 10       | 3       | 1509.060000 (OP/s) |
| Rr Results  | TCP_RR   | 1           | false        | false   | 1024         | false     | 10       | 3       | 3508.320000 (OP/s) |
+-------------+----------+-------------+--------------+---------+--------------+-----------+----------+---------+--------------------+
+------------------------+------------+-------------+--------------+---------+--------------+-----------+----------+---------+--------------------+
|      RESULT TYPE       |  SCENARIO  | PARALLELISM | HOST NETWORK | SERVICE | MESSAGE SIZE | SAME NODE | DURATION | SAMPLES |   99%TILE VALUE    |
+------------------------+------------+-------------+--------------+---------+--------------+-----------+----------+---------+--------------------+
| Stream Latency Results | TCP_STREAM | 1           | false        | false   | 1024         | false     | 10       | 3       | 4890.580000 (usec) |
| Stream Latency Results | TCP_STREAM | 1           | false        | false   | 8192         | false     | 10       | 3       | 4926.630000 (usec) |
| Stream Latency Results | UDP_STREAM | 1           | false        | false   | 1024         | false     | 10       | 3       | 1574.320000 (usec) |
+------------------------+------------+-------------+--------------+---------+--------------+-----------+----------+---------+--------------------+
+--------------------+----------+-------------+--------------+---------+--------------+-----------+----------+---------+--------------------+
|    RESULT TYPE     | SCENARIO | PARALLELISM | HOST NETWORK | SERVICE | MESSAGE SIZE | SAME NODE | DURATION | SAMPLES |   99%TILE VALUE    |
+--------------------+----------+-------------+--------------+---------+--------------+-----------+----------+---------+--------------------+
| Rr Latency Results | TCP_CRR  | 1           | false        | false   | 1024         | false     | 10       | 3       | 1509.090000 (usec) |
| Rr Latency Results | TCP_CRR  | 1           | false        | true    | 1024         | false     | 10       | 3       | 1509.060000 (usec) |
| Rr Latency Results | TCP_RR   | 1           | false        | false   | 1024         | false     | 10       | 3       | 3508.320000 (usec) |
+--------------------+----------+-------------+--------------+---------+--------------+-----------+----------+---------+--------------------+
+----------------------+--------+------------+-------------+--------------+---------+--------------+-----------+-----------+----------+------------+-----------+------------+----------+-------------+----------+
|     RESULT TYPE      |  ROLE  |  SCENARIO  | PARALLELISM | HOST NETWORK | SERVICE | MESSAGE SIZE | SAME NODE | IDLE CPU  | USER CPU | SYSTEM CPU | STEAL CPU | IOWAIT CPU | NICE CPU | SOFTIRQ CPU | IRQ CPU  |
+----------------------+--------+------------+-------------+--------------+---------+--------------+-----------+-----------+----------+------------+-----------+------------+----------+-------------+----------+
| Node CPU Utilization | Client | TCP_STREAM | 1           | false        | false   | 1024         | false     | 96.558929 | 2.645833 | 0.484524   | 0.002381  | 0.000000   | 0.000000 | 0.085714    | 0.144643 |
| Node CPU Utilization | Server | TCP_STREAM | 1           | false        | false   | 1024         | false     | 96.144048 | 2.933929 | 0.544643   | 0.002381  | 0.004167   | 0.007738 | 0.111310    | 0.161310 |
| Node CPU Utilization | Client | TCP_STREAM | 1           | false        | false   | 8192         | false     | 95.205357 | 2.960714 | 0.970238   | 0.002381  | 0.000595   | 0.000000 | 0.589881    | 0.177381 |
| Node CPU Utilization | Server | TCP_STREAM | 1           | false        | false   | 8192         | false     | 94.752381 | 2.969048 | 0.915476   | 0.001786  | 0.003571   | 0.007738 | 0.950000    | 0.219048 |
| Node CPU Utilization | Client | UDP_STREAM | 1           | false        | false   | 1024         | false     | 93.033929 | 3.683929 | 1.427381   | 0.002381  | 0.002381   | 0.000000 | 1.519048    | 0.247024 |
| Node CPU Utilization | Server | UDP_STREAM | 1           | false        | false   | 1024         | false     | 92.036310 | 3.263690 | 1.585119   | 0.002381  | 0.002976   | 0.008333 | 2.454762    | 0.325000 |
| Node CPU Utilization | Client | TCP_CRR    | 1           | false        | false   | 1024         | false     | 91.353571 | 3.914881 | 2.017262   | 0.002976  | 0.002976   | 0.000000 | 2.321429    | 0.291071 |
| Node CPU Utilization | Server | TCP_CRR    | 1           | false        | false   | 1024         | false     | 90.775595 | 3.511310 | 2.101190   | 0.002976  | 0.000595   | 0.008333 | 3.126786    | 0.364286 |
| Node CPU Utilization | Client | TCP_CRR    | 1           | false        | true    | 1024         | false     | 93.053360 | 3.175797 | 1.600992   | 0.003571  | 0.002381   | 0.000000 | 1.889647    | 0.297582 |
| Node CPU Utilization | Server | TCP_CRR    | 1           | false        | true    | 1024         | false     | 93.360119 | 2.989881 | 1.475595   | 0.002976  | 0.000595   | 0.008333 | 1.859524    | 0.321429 |
| Node CPU Utilization | Client | TCP_RR     | 1           | false        | false   | 1024         | false     | 94.250595 | 3.063095 | 1.200595   | 0.003571  | 0.001786   | 0.000000 | 1.169048    | 0.316071 |
| Node CPU Utilization | Server | TCP_RR     | 1           | false        | false   | 1024         | false     | 94.434524 | 3.316667 | 0.918452   | 0.002381  | 0.002381   | 0.007738 | 0.958333    | 0.327381 |
+----------------------+--------+------------+-------------+--------------+---------+--------------+-----------+-----------+----------+------------+-----------+------------+----------+-------------+----------+
+---------------------+--------+------------+-------------+--------------+---------+--------------+-----------+----------------------+-------------+
|     RESULT TYPE     |  ROLE  |  SCENARIO  | PARALLELISM | HOST NETWORK | SERVICE | MESSAGE SIZE | SAME NODE |         POD          | UTILIZATION |
+---------------------+--------+------------+-------------+--------------+---------+--------------+-----------+----------------------+-------------+
| Pod CPU Utilization | Client | TCP_STREAM | 1           | false        | false   | 1024         | false     | node-exporter-vrpcm  | 0.541330    |
| Pod CPU Utilization | Client | TCP_STREAM | 1           | false        | false   | 1024         | false     | prometheus-k8s-0     | 37.649868   |
| Pod CPU Utilization | Client | TCP_STREAM | 1           | false        | false   | 1024         | false     | multus-pgjns         | 1.041955    |
| Pod CPU Utilization | Client | TCP_STREAM | 1           | false        | false   | 1024         | false     | ovnkube-node-j2q82   | 1.189691    |
| Pod CPU Utilization | Client | TCP_STREAM | 1           | false        | false   | 1024         | false     | noobaa-operator-c764 | 0.958517    |
| Pod CPU Utilization | Server | TCP_STREAM | 1           | false        | false   | 1024         | false     | prometheus-k8s-1     | 57.829749   |
| Pod CPU Utilization | Server | TCP_STREAM | 1           | false        | false   | 1024         | false     | multus-s6424         | 1.205722    |
| Pod CPU Utilization | Server | TCP_STREAM | 1           | false        | false   | 1024         | false     | ovnkube-node-5kgrk   | 1.163873    |
| Pod CPU Utilization | Server | TCP_STREAM | 1           | false        | false   | 1024         | false     | noobaa-db-pg-0       | 1.052798    |
| Pod CPU Utilization | Server | TCP_STREAM | 1           | false        | false   | 1024         | false     | example-registry-qua | 2.223189    |
| Pod CPU Utilization | Client | TCP_STREAM | 1           | false        | false   | 8192         | false     | client-across-54d575 | 55.045584   |
| Pod CPU Utilization | Client | TCP_STREAM | 1           | false        | false   | 8192         | false     | prometheus-k8s-0     | 38.347985   |
| Pod CPU Utilization | Client | TCP_STREAM | 1           | false        | false   | 8192         | false     | multus-pgjns         | 1.170053    |
| Pod CPU Utilization | Client | TCP_STREAM | 1           | false        | false   | 8192         | false     | ovnkube-node-j2q82   | 1.175858    |
| Pod CPU Utilization | Client | TCP_STREAM | 1           | false        | false   | 8192         | false     | noobaa-operator-c764 | 1.044789    |
| Pod CPU Utilization | Server | TCP_STREAM | 1           | false        | false   | 8192         | false     | server-5d54979c7d-ng | 13.792934   |
| Pod CPU Utilization | Server | TCP_STREAM | 1           | false        | false   | 8192         | false     | prometheus-k8s-1     | 43.291624   |
| Pod CPU Utilization | Server | TCP_STREAM | 1           | false        | false   | 8192         | false     | multus-s6424         | 1.209418    |
| Pod CPU Utilization | Server | TCP_STREAM | 1           | false        | false   | 8192         | false     | ovnkube-node-5kgrk   | 1.169186    |
| Pod CPU Utilization | Server | TCP_STREAM | 1           | false        | false   | 8192         | false     | example-registry-qua | 2.013223    |
| Pod CPU Utilization | Client | UDP_STREAM | 1           | false        | false   | 1024         | false     | client-across-54d575 | 41.012823   |
| Pod CPU Utilization | Client | UDP_STREAM | 1           | false        | false   | 1024         | false     | prometheus-k8s-0     | 42.908681   |
| Pod CPU Utilization | Client | UDP_STREAM | 1           | false        | false   | 1024         | false     | multus-pgjns         | 1.150802    |
| Pod CPU Utilization | Client | UDP_STREAM | 1           | false        | false   | 1024         | false     | ovnkube-node-j2q82   | 1.722545    |
| Pod CPU Utilization | Client | UDP_STREAM | 1           | false        | false   | 1024         | false     | noobaa-operator-c764 | 0.840597    |
| Pod CPU Utilization | Server | UDP_STREAM | 1           | false        | false   | 1024         | false     | server-5d54979c7d-ng | 43.487938   |
| Pod CPU Utilization | Server | UDP_STREAM | 1           | false        | false   | 1024         | false     | prometheus-k8s-1     | 37.482060   |
| Pod CPU Utilization | Server | UDP_STREAM | 1           | false        | false   | 1024         | false     | ovnkube-node-5kgrk   | 1.163326    |
| Pod CPU Utilization | Server | UDP_STREAM | 1           | false        | false   | 1024         | false     | noobaa-db-pg-0       | 0.907211    |
| Pod CPU Utilization | Server | UDP_STREAM | 1           | false        | false   | 1024         | false     | example-registry-qua | 1.671633    |
| Pod CPU Utilization | Client | TCP_CRR    | 1           | false        | false   | 1024         | false     | client-across-54d575 | 36.851356   |
| Pod CPU Utilization | Client | TCP_CRR    | 1           | false        | false   | 1024         | false     | prometheus-k8s-0     | 36.741161   |
| Pod CPU Utilization | Client | TCP_CRR    | 1           | false        | false   | 1024         | false     | multus-pgjns         | 0.934561    |
| Pod CPU Utilization | Client | TCP_CRR    | 1           | false        | false   | 1024         | false     | ovnkube-node-j2q82   | 1.770500    |
| Pod CPU Utilization | Client | TCP_CRR    | 1           | false        | false   | 1024         | false     | noobaa-operator-c764 | 1.184292    |
| Pod CPU Utilization | Server | TCP_CRR    | 1           | false        | false   | 1024         | false     | server-5d54979c7d-ng | 31.412553   |
| Pod CPU Utilization | Server | TCP_CRR    | 1           | false        | false   | 1024         | false     | prometheus-k8s-1     | 37.194798   |
| Pod CPU Utilization | Server | TCP_CRR    | 1           | false        | false   | 1024         | false     | ovnkube-node-5kgrk   | 1.206854    |
| Pod CPU Utilization | Server | TCP_CRR    | 1           | false        | false   | 1024         | false     | noobaa-db-pg-0       | 1.743124    |
| Pod CPU Utilization | Server | TCP_CRR    | 1           | false        | false   | 1024         | false     | example-registry-qua | 2.162041    |
| Pod CPU Utilization | Client | TCP_CRR    | 1           | false        | true    | 1024         | false     | client-across-54d575 | 4.675419    |
| Pod CPU Utilization | Client | TCP_CRR    | 1           | false        | true    | 1024         | false     | prometheus-k8s-0     | 32.855630   |
| Pod CPU Utilization | Client | TCP_CRR    | 1           | false        | true    | 1024         | false     | multus-pgjns         | 0.887057    |
| Pod CPU Utilization | Client | TCP_CRR    | 1           | false        | true    | 1024         | false     | ovnkube-node-j2q82   | 1.286614    |
| Pod CPU Utilization | Client | TCP_CRR    | 1           | false        | true    | 1024         | false     | noobaa-operator-c764 | 1.018654    |
| Pod CPU Utilization | Server | TCP_CRR    | 1           | false        | true    | 1024         | false     | server-5d54979c7d-ng | 3.472448    |
| Pod CPU Utilization | Server | TCP_CRR    | 1           | false        | true    | 1024         | false     | prometheus-k8s-1     | 35.092636   |
| Pod CPU Utilization | Server | TCP_CRR    | 1           | false        | true    | 1024         | false     | multus-s6424         | 1.234353    |
| Pod CPU Utilization | Server | TCP_CRR    | 1           | false        | true    | 1024         | false     | ovnkube-node-5kgrk   | 1.635867    |
| Pod CPU Utilization | Server | TCP_CRR    | 1           | false        | true    | 1024         | false     | example-registry-qua | 2.037027    |
| Pod CPU Utilization | Client | TCP_RR     | 1           | false        | false   | 1024         | false     | client-across-54d575 | 4.446356    |
| Pod CPU Utilization | Client | TCP_RR     | 1           | false        | false   | 1024         | false     | prometheus-k8s-0     | 37.547653   |
| Pod CPU Utilization | Client | TCP_RR     | 1           | false        | false   | 1024         | false     | multus-pgjns         | 1.056455    |
| Pod CPU Utilization | Client | TCP_RR     | 1           | false        | false   | 1024         | false     | ovnkube-node-j2q82   | 1.113297    |
| Pod CPU Utilization | Client | TCP_RR     | 1           | false        | false   | 1024         | false     | noobaa-operator-c764 | 0.951374    |
| Pod CPU Utilization | Server | TCP_RR     | 1           | false        | false   | 1024         | false     | prometheus-k8s-1     | 35.550038   |
| Pod CPU Utilization | Server | TCP_RR     | 1           | false        | false   | 1024         | false     | multus-s6424         | 0.980985    |
| Pod CPU Utilization | Server | TCP_RR     | 1           | false        | false   | 1024         | false     | ovnkube-node-5kgrk   | 1.178838    |
| Pod CPU Utilization | Server | TCP_RR     | 1           | false        | false   | 1024         | false     | noobaa-db-pg-0       | 1.354869    |
| Pod CPU Utilization | Server | TCP_RR     | 1           | false        | false   | 1024         | false     | example-registry-qua | 2.041465    |
+---------------------+--------+------------+-------------+--------------+---------+--------------+-----------+----------------------+-------------+