Beuth-Erdelt / Benchmark-Experiment-Host-Manager

This python tool helps managing DBMS benchmarking experiments in a Kubernetes-based HPC cluster environment. It enables users to configure hardware / software setups for easily repeating tests over varying configurations.
GNU Affero General Public License v3.0
6 stars 0 forks source link

YCSB: Summary should show number of experiment #246

Closed perdelt closed 7 months ago

perdelt commented 8 months ago

for -nc>1

perdelt commented 8 months ago
## Show Summary

### Loading
                       threads  target  pod_count  [OVERALL].Throughput(ops/sec)  [OVERALL].RunTime(ms)  [INSERT].Return=OK  [INSERT].99thPercentileLatency(us)
PostgreSQL-64-1-16384       64   16384          1                   16277.366322                61435.0             1000000                              1839.0

### Execution
                            threads  target  pod_count  [OVERALL].Throughput(ops/sec)  [OVERALL].RunTime(ms)  [READ].Return=OK  [READ].99thPercentileLatency(us)  [UPDATE].Return=OK  [UPDATE].99thPercentileLatency(us)
PostgreSQL-64-1-16384-1-1        64   16384          1                       16276.57                61438.0            499411                            546.00              500589                              727.00
PostgreSQL-64-1-16384-2-1        64   16384          1                       16280.28                61424.0            500327                            557.00              499673                              689.00
PostgreSQL-64-8-16384-1-1        64   16384          8                       16312.98                61315.0            499007                            588.25              500993                              765.50
PostgreSQL-64-8-16384-2-1        64   16384          8                       16313.51                61308.0            499899                            536.62              500101                              662.00
PostgreSQL-64-1-32768-1-1        64   32768          1                       32318.53                30942.0            499610                            751.00              500390                             1382.00
PostgreSQL-64-1-32768-2-1        64   32768          1                       32340.48                30921.0            500552                            646.00              499448                              958.00
PostgreSQL-64-8-32768-1-1        64   32768          8                       32482.83                30793.0            500914                            532.88              499086                              715.50
PostgreSQL-64-8-32768-2-1        64   32768          8                       32449.29                31016.0            499572                            543.88              500428                              694.88
PostgreSQL-64-1-49152-1-1        64   49152          1                       47632.66                20994.0            500113                            810.00              499887                             1327.00
PostgreSQL-64-1-49152-2-1        64   49152          1                       48220.66                20738.0            499230                            890.00              500770                             1369.00
PostgreSQL-64-8-49152-1-1        64   49152          8                       48442.59                20837.0            500483                            850.00              499517                             1419.12
PostgreSQL-64-8-49152-2-1        64   49152          8                       48083.67                21349.0            500496                            774.62              499504                             1275.12
PostgreSQL-64-1-65536-1-1        64   65536          1                       63673.99                15705.0            499652                           1379.00              500348                             1932.00
PostgreSQL-64-1-65536-2-1        64   65536          1                       62212.27                16074.0            499962                           1226.00              500038                             1633.00
PostgreSQL-64-8-65536-1-1        64   65536          8                       64392.54                15537.0            499717                           1088.88              500283                             1514.25
PostgreSQL-64-8-65536-2-1        64   65536          8                       61825.29                16448.0            500313                           1233.12              499687                             1653.88
PostgreSQL-64-1-81920-1-1        64   81920          1                       73110.10                13678.0            499299                           1385.00              500701                             1938.00
PostgreSQL-64-1-81920-2-1        64   81920          1                       79063.88                12648.0            500048                           1382.00              499952                             1949.00
PostgreSQL-64-8-81920-1-1        64   81920          8                       79545.32                12855.0            499899                           1472.88              500101                             2686.50
PostgreSQL-64-8-81920-2-1        64   81920          8                       77873.10                13265.0            499459                           1667.25              500541                             3494.75
PostgreSQL-64-1-98304-1-1        64   98304          1                       83347.22                11998.0            499218                           1758.00              500782                             4099.00
PostgreSQL-64-1-98304-2-1        64   98304          1                       85258.76                11729.0            500255                           1703.00              499745                             3891.00
PostgreSQL-64-8-98304-1-1        64   98304          8                       85854.31                12060.0            499128                           2142.62              500872                             3830.00
PostgreSQL-64-8-98304-2-1        64   98304          8                       93031.55                11527.0            499949                           1746.38              500051                             3019.25
PostgreSQL-64-1-114688-1-1       64  114688          1                       89277.74                11201.0            499753                           1712.00              500247                             3259.00
PostgreSQL-64-1-114688-2-1       64  114688          1                      100654.25                 9935.0            499487                           1515.00              500513                             2567.00
PostgreSQL-64-8-114688-1-1       64  114688          8                      103459.18                10031.0            500486                           2091.75              499514                             3094.75
PostgreSQL-64-8-114688-2-1       64  114688          8                       68467.21                15024.0            499450                           2471.00              500550                             5012.50
PostgreSQL-64-1-131072-1-1       64  131072          1                      104362.35                 9582.0            499870                           1568.00              500130                             2471.00
PostgreSQL-64-1-131072-2-1       64  131072          1                       92541.18                10806.0            499577                           1629.00              500423                             2895.00
PostgreSQL-64-8-131072-1-1       64  131072          8                      102718.80                10187.0            501191                           2012.25              498809                             4263.50
PostgreSQL-64-8-131072-2-1       64  131072          8                      107284.08                 9578.0            500422                           1723.12              499578                             2804.00

### Ingestion
                           SUT - CPU of Ingestion (via counter) [CPUs]  SUT - Max RAM of Ingestion [Gb]
PostgreSQL-64-1-16384-1-1                                       214.98                             3.51

### Execution
                            SUT - CPU of Execution (via counter) [CPUs]  SUT - Max RAM of Execution [Gb]
PostgreSQL-64-1-16384-1-1                                        158.55                             4.01
PostgreSQL-64-1-16384-2-1                                        140.43                             4.01
PostgreSQL-64-1-32768-1-1                                        153.68                             2.31
PostgreSQL-64-1-32768-2-1                                        124.00                             3.98
PostgreSQL-64-1-49152-1-1                                          0.30                             2.31
PostgreSQL-64-1-49152-2-1                                          0.30                             2.31
PostgreSQL-64-1-65536-1-1                                          0.30                             2.31
PostgreSQL-64-1-65536-2-1                                        140.33                             4.02
PostgreSQL-64-1-81920-1-1                                          0.28                             2.31
PostgreSQL-64-1-81920-2-1                                        206.75                             3.64
PostgreSQL-64-1-98304-1-1                                          0.28                             2.31
PostgreSQL-64-1-98304-2-1                                         78.68                             3.77
PostgreSQL-64-1-114688-1-1                                        61.27                             3.58
PostgreSQL-64-1-114688-2-1                                       201.62                             3.68
PostgreSQL-64-1-131072-1-1                                       177.17                             3.88
PostgreSQL-64-1-131072-2-1                                       193.99                             3.70
PostgreSQL-64-8-16384-1-1                                        182.05                             4.10
PostgreSQL-64-8-16384-2-1                                         93.77                             3.86
PostgreSQL-64-8-32768-1-1                                        172.90                             4.11
PostgreSQL-64-8-32768-2-1                                         61.65                             3.65
PostgreSQL-64-8-49152-1-1                                        184.04                             3.71
PostgreSQL-64-8-49152-2-1                                        180.38                             3.70
PostgreSQL-64-8-65536-1-1                                        182.94                             3.69
PostgreSQL-64-8-65536-2-1                                         21.57                             3.03
PostgreSQL-64-8-81920-1-1                                         62.36                             3.63
PostgreSQL-64-8-81920-2-1                                         36.45                             3.28
PostgreSQL-64-8-98304-1-1                                        187.09                             3.72
PostgreSQL-64-8-98304-2-1                                        140.81                             4.07
PostgreSQL-64-8-114688-1-1                                         0.30                             2.31
PostgreSQL-64-8-114688-2-1                                       120.80                             3.98
PostgreSQL-64-8-131072-1-1                                       190.32                             3.00
PostgreSQL-64-8-131072-2-1                                       185.64                             3.73

for nohup python ycsb.py -ms 1 -dbms PostgreSQL -workload a -tr -rnn cl-worker11 -m -rnl cl-worker19 -rnb cl-worker19 -nc 2 -rst local-hdd -rss 50Gi -db run &>tmp31f.log&