search

tjeyy / dyod22-memory-tracking

Hyrise is a research in-memory database.
https://hpi.de/plattner/projects/hyrise.html
MIT License
1 stars 0 forks source link

Exchange HashMap in JoinHash #26

Closed tjeyy closed 2 years ago

tjeyy commented 2 years ago 
+Configuration Overview----+------------------------------------------+------------------------------------------+
| Parameter                | ../../temp/master.json                   | ../../temp/sparse_map.json               |
+--------------------------+------------------------------------------+------------------------------------------+
|  GIT-HASH                | 21d65577f5448d4540b8d36ccb4c6bb08a62414b | 425c36ef39d69011282d040de86e44d6197c8ac9 |
|  benchmark_mode          | Ordered                                  | Ordered                                  |
| !build_type              | debug                                    | debug                                    |
|  chunk_size              | 65535                                    | 65535                                    |
|  clients                 | 1                                        | 1                                        |
|  clustering              | None                                     | None                                     |
|  compiler                | gcc 11.2                                 | gcc 11.2                                 |
|  cores                   | 0                                        | 0                                        |
|  data_preparation_cores  | 0                                        | 0                                        |
|  date                    | 2022-07-11 10:39:54                      | 2022-07-11 11:49:35                      |
|  encoding                | {'default': {'encoding': 'Dictionary'}}  | {'default': {'encoding': 'Dictionary'}}  |
|  indexes                 | False                                    | False                                    |
|  max_duration            | 60000000000                              | 60000000000                              |
|  max_runs                | -1                                       | -1                                       |
|  scale_factor            | 10.0                                     | 10.0                                     |
|  time_unit               | ns                                       | ns                                       |
|  use_prepared_statements | False                                    | False                                    |
|  using_scheduler         | False                                    | False                                    |
|  verify                  | False                                    | False                                    |
|  warmup_duration         | 0                                        | 0                                        |
+--------------------------+------------------------------------------+------------------------------------------+

+----------++-----------+-----------+--------++----------+----------+--------+---------+
| Item     || Latency (ms/iter)     | Change || Throughput (iter/s) | Change | p-value |
|          ||       old |       new |        ||      old |      new |        |         |
+----------++-----------+-----------+--------++----------+----------+--------+---------+
| TPC-H 01 ||  414334.4 |  431873.8 |   +4%  ||     0.00 |     0.00 |   -4%  |       ˅ |
| TPC-H 02 ||    3631.6 |    3565.3 |   -2%  ||     0.28 |     0.28 |   +2%  |  0.6145 |
| TPC-H 03 ||   60353.8 |   97684.1 |  +62%  ||     0.02 |     0.01 |  -38%  |       ˅ |
| TPC-H 04 ||   52096.7 |   61310.2 |  +18%  ||     0.02 |     0.02 |  -15%  |       ˅ |
| TPC-H 05 ||   81357.7 |  112227.7 |  +38%  ||     0.01 |     0.01 |  -28%  |       ˅ |
| TPC-H 06 ||   23810.3 |   24806.6 |   +4%  ||     0.04 |     0.04 |   -4%  |       ˅ |
| TPC-H 07 ||   39502.7 |   45755.5 |  +16%  ||     0.03 |     0.02 |  -14%  |       ˅ |
| TPC-H 08 ||   33353.2 |   36014.2 |   +8%  ||     0.03 |     0.03 |   -7%  |       ˅ |
| TPC-H 09 ||  128114.1 |  141695.1 |  +11%  ||     0.01 |     0.01 |  -10%  |       ˅ |
| TPC-H 10 ||   61895.4 |   75822.9 |  +23%  ||     0.02 |     0.01 |  -18%  |       ˅ |
| TPC-H 11 ||    4773.4 |    5061.3 |   +6%  ||     0.21 |     0.20 |   -6%  |  0.3158 |
| TPC-H 12 ||   47554.2 |   53478.6 |  +12%  ||     0.02 |     0.02 |  -11%  |       ˅ |
| TPC-H 13 ||   84929.8 |   96845.2 |  +14%  ||     0.01 |     0.01 |  -12%  |       ˅ |
| TPC-H 14 ||   22136.0 |   23545.6 |   +6%  ||     0.05 |     0.04 |   -6%  |       ˅ |
| TPC-H 15 ||   21787.1 |   21897.4 |   +1%  ||     0.05 |     0.05 |   -1%  |       ˅ |
| TPC-H 16 ||   24388.6 |   28459.2 |  +17%  ||     0.04 |     0.04 |  -14%  |       ˅ |
| TPC-H 17 ||   22458.1 |   18966.8 |  -16%  ||     0.04 |     0.05 |  +18%  |       ˅ |
| TPC-H 18 ||   80187.7 |   79803.9 |   -0%  ||     0.01 |     0.01 |   +0%  |       ˅ |
| TPC-H 19 ||   22858.5 |   21407.6 |   -6%  ||     0.04 |     0.05 |   +7%  |       ˅ |
| TPC-H 20 ||   25509.3 |   26243.3 |   +3%  ||     0.04 |     0.04 |   -3%  |       ˅ |
| TPC-H 21 ||  124230.5 |  157630.3 |  +27%  ||     0.01 |     0.01 |  -21%  |       ˅ |
| TPC-H 22 ||   13748.9 |   14623.0 |   +6%  ||     0.07 |     0.07 |   -6%  |       ˅ |
+----------++-----------+-----------+--------++----------+----------+--------+---------+
| Sum      || 1393011.8 | 1578717.7 |  +13%  ||          |          |        |         |
| Geomean  ||           |           |        ||          |          |   -9%  |         |
+----------++-----------+-----------+--------++----------+----------+--------+---------+
|          || ˅ Insufficient number of runs for p-value calculation                    |
+----------++-----------+-----------+--------++----------+----------+--------+---------+
tjeyy commented 2 years ago 
+Configuration Overview----+------------------------------------------+------------------------------------------------+
| Parameter                | ./bencharks/master.json                  | bencharks/sparse.json                          |
+--------------------------+------------------------------------------+------------------------------------------------+
|  GIT-HASH                | ee0f9f61121e2a7b230e44cfdf319439c50ee340 | 425c36ef39d69011282d040de86e44d6197c8ac9-dirty |
|  benchmark_mode          | Ordered                                  | Ordered                                        |
| !build_type              | debug                                    | debug                                          |
|  chunk_size              | 65535                                    | 65535                                          |
|  clients                 | 1                                        | 1                                              |
|  clustering              | None                                     | None                                           |
|  compiler                | gcc 9.2                                  | gcc 9.2                                        |
|  cores                   | 0                                        | 0                                              |
|  data_preparation_cores  | 0                                        | 0                                              |
|  date                    | 2022-07-12 13:59:57                      | 2022-07-12 15:50:15                            |
|  encoding                | {'default': {'encoding': 'Dictionary'}}  | {'default': {'encoding': 'Dictionary'}}        |
|  indexes                 | False                                    | False                                          |
|  max_duration            | 60000000000                              | 60000000000                                    |
|  max_runs                | -1                                       | -1                                             |
|  scale_factor            | 10.0                                     | 10.0                                           |
|  time_unit               | ns                                       | ns                                             |
|  use_prepared_statements | False                                    | False                                          |
|  using_scheduler         | False                                    | False                                          |
|  verify                  | False                                    | False                                          |
|  warmup_duration         | 0                                        | 0                                              |
+--------------------------+------------------------------------------+------------------------------------------------+

+----------++-----------+-----------+--------++----------+----------+--------+---------+
| Item     || Latency (ms/iter)     | Change || Throughput (iter/s) | Change | p-value |
|          ||       old |       new |        ||      old |      new |        |         |
+----------++-----------+-----------+--------++----------+----------+--------+---------+
| TPC-H 01 ||  518206.3 |  490877.0 |   -5%  ||     0.00 |     0.00 |   +6%  |       ˅ |
| TPC-H 02 ||    4603.4 |    4621.9 |   +0%  ||     0.22 |     0.22 |   -0%  |  0.3304 |
| TPC-H 03 ||   78818.9 |  112488.4 |  +43%  ||     0.01 |     0.01 |  -30%  |       ˅ |
| TPC-H 04 ||   62349.5 |   78183.7 |  +25%  ||     0.02 |     0.01 |  -20%  |       ˅ |
| TPC-H 05 ||   93400.7 |  125589.4 |  +34%  ||     0.01 |     0.01 |  -26%  |       ˅ |
| TPC-H 06 ||   30049.7 |   29045.3 |   -3%  ||     0.03 |     0.03 |   +3%  |       ˅ |
| TPC-H 07 ||   49014.0 |   55026.0 |  +12%  ||     0.02 |     0.02 |  -11%  |       ˅ |
| TPC-H 08 ||   39765.7 |   45909.6 |  +15%  ||     0.03 |     0.02 |  -13%  |       ˅ |
| TPC-H 09 ||  151143.7 |  164354.2 |   +9%  ||     0.01 |     0.01 |   -8%  |       ˅ |
| TPC-H 10 ||   77468.8 |   94538.5 |  +22%  ||     0.01 |     0.01 |  -18%  |       ˅ |
| TPC-H 11 ||    5602.8 |    5976.8 |   +7%  ||     0.18 |     0.17 |   -6%  |  0.0000 |
| TPC-H 12 ||   60974.0 |   61953.3 |   +2%  ||     0.02 |     0.02 |   -2%  |       ˅ |
| TPC-H 13 ||   95043.8 |  105203.5 |  +11%  ||     0.01 |     0.01 |  -10%  |       ˅ |
| TPC-H 14 ||   25815.9 |   26726.8 |   +4%  ||     0.04 |     0.04 |   -3%  |       ˅ |
| TPC-H 15 ||   24443.9 |   24957.6 |   +2%  ||     0.04 |     0.04 |   -2%  |       ˅ |
| TPC-H 16 ||   31615.5 |   34110.1 |   +8%  ||     0.03 |     0.03 |   -7%  |       ˅ |
| TPC-H 17 ||   24517.2 |   25129.6 |   +2%  ||     0.04 |     0.04 |   -2%  |       ˅ |
| TPC-H 18 ||  104851.0 |  100616.7 |   -4%  ||     0.01 |     0.01 |   +4%  |       ˅ |
| TPC-H 19 ||   27663.4 |   27849.7 |   +1%  ||     0.04 |     0.04 |   -1%  |       ˅ |
| TPC-H 20 ||   31064.5 |   32655.1 |   +5%  ||     0.03 |     0.03 |   -5%  |       ˅ |
| TPC-H 21 ||  151594.6 |  191074.9 |  +26%  ||     0.01 |     0.01 |  -21%  |       ˅ |
| TPC-H 22 ||   17132.4 |   17666.5 |   +3%  ||     0.06 |     0.06 |   -3%  |       ˅ |
+----------++-----------+-----------+--------++----------+----------+--------+---------+
| Sum      || 1705139.6 | 1854554.7 |   +9%  ||          |          |        |         |
| Geomean  ||           |           |        ||          |          |   -8%  |         |
+----------++-----------+-----------+--------++----------+----------+--------+---------+
|          || ˅ Insufficient number of runs for p-value calculation                    |
+----------++-----------+-----------+--------++----------+----------+--------+---------+