xuchuanyin / workbench

0 stars 0 forks source link

2018-10-17 PR2728 #65

Open xuchuanyin opened 5 years ago

xuchuanyin commented 5 years ago

before:

+----------------------+----------+------+---------+--------+--------+--------+--------+--------+--------+--------+
|         query        |    avg   | size |  total  |   min  |   max  |   25%  |   50%  |   75%  |   90%  |   95%  |
+----------------------+----------+------+---------+--------+--------+--------+--------+--------+--------+--------+
|          ALL         |  72530.0 |  24  | 1740722 |   381  | 474330 |  1215  |  15200 |  72924 | 445150 | 456263 |
| carbon-load-customer |  8769.0  |   3  |  26309  |  8213  |  9577  |  8213  |  8519  |  9577  |  9577  |  9577  |
| carbon-load-lineitem | 458581.0 |   3  | 1375743 | 445150 | 474330 | 445150 | 456263 | 474330 | 474330 | 474330 |
|  carbon-load-nation  |   849.0  |   3  |   2549  |   385  |  1215  |   385  |   949  |  1215  |  1215  |  1215  |
|  carbon-load-orders  |  74012.0 |   3  |  222038 |  72924 |  74952 |  72924 |  74162 |  74952 |  74952 |  74952 |
|   carbon-load-part   |  15819.0 |   3  |  47459  |  15200 |  16758 |  15200 |  15501 |  16758 |  16758 |  16758 |
| carbon-load-partsupp |  20056.0 |   3  |  60170  |  19035 |  21000 |  19035 |  20135 |  21000 |  21000 |  21000 |
|  carbon-load-region  |   652.0  |   3  |   1956  |   381  |  1032  |   381  |   543  |  1032  |  1032  |  1032  |
| carbon-load-supplier |  1499.0  |   3  |   4498  |  1056  |  1776  |  1056  |  1666  |  1776  |  1776  |  1776  |
+----------------------+----------+------+---------+--------+--------+--------+--------+--------+--------+--------+

+-------------------------+----------+------+---------+--------+--------+--------+--------+--------+--------+--------+
|          query          |    avg   | size |  total  |   min  |   max  |   25%  |   50%  |   75%  |   90%  |   95%  |
+-------------------------+----------+------+---------+--------+--------+--------+--------+--------+--------+--------+
|           ALL           | 126422.0 |   8  | 1011377 |   755  | 740226 |  2735  |  21657 | 138104 | 740226 | 740226 |
| carbon-compact-customer |  18618.0 |   1  |  18618  |  18618 |  18618 |  18618 |  18618 |  18618 |  18618 |  18618 |
| carbon-compact-lineitem | 740226.0 |   1  |  740226 | 740226 | 740226 | 740226 | 740226 | 740226 | 740226 | 740226 |
|  carbon-compact-nation  |  1149.0  |   1  |   1149  |  1149  |  1149  |  1149  |  1149  |  1149  |  1149  |  1149  |
|  carbon-compact-orders  | 138104.0 |   1  |  138104 | 138104 | 138104 | 138104 | 138104 | 138104 | 138104 | 138104 |
|   carbon-compact-part   |  21657.0 |   1  |  21657  |  21657 |  21657 |  21657 |  21657 |  21657 |  21657 |  21657 |
| carbon-compact-partsupp |  88133.0 |   1  |  88133  |  88133 |  88133 |  88133 |  88133 |  88133 |  88133 |  88133 |
|  carbon-compact-region  |   755.0  |   1  |   755   |   755  |   755  |   755  |   755  |   755  |   755  |   755  |
| carbon-compact-supplier |  2735.0  |   1  |   2735  |  2735  |  2735  |  2735  |  2735  |  2735  |  2735  |  2735  |
+-------------------------+----------+------+---------+--------+--------+--------+--------+--------+--------+--------+
xuchuanyin commented 5 years ago

nmon for data loading for 3 times each with 106GB tpch

perf-carbon-slave-0001_181017_1722.nmon.xlsx perf-carbon-slave-0002_181017_1722.nmon.xlsx perf-carbon-slave-0003_181017_1722.nmon.xlsx

nmon for compaction with 3 segments

perf-carbon-slave-0001_181017_1811.nmon.xlsx perf-carbon-slave-0002_181017_1811.nmon.xlsx perf-carbon-slave-0003_181017_1811.nmon.xlsx

xuchuanyin commented 5 years ago

AFTER

+----------------------+----------+------+---------+--------+--------+--------+--------+--------+--------+--------+
|         query        |    avg   | size |  total  |   min  |   max  |   25%  |   50%  |   75%  |   90%  |   95%  |
+----------------------+----------+------+---------+--------+--------+--------+--------+--------+--------+--------+
|          ALL         |  73135.0 |  24  | 1755258 |   394  | 467837 |  1823  |  14161 |  74423 | 445992 | 461304 |
| carbon-load-customer |  7848.0  |   3  |  23545  |  7036  |  8536  |  7036  |  7973  |  8536  |  8536  |  8536  |
| carbon-load-lineitem | 458377.0 |   3  | 1375133 | 445992 | 467837 | 445992 | 461304 | 467837 | 467837 | 467837 |
|  carbon-load-nation  |   474.0  |   3  |   1423  |   394  |   602  |   394  |   427  |   602  |   602  |   602  |
|  carbon-load-orders  |  76865.0 |   3  |  230595 |  74423 |  78313 |  74423 |  77859 |  78313 |  78313 |  78313 |
|   carbon-load-part   |  14947.0 |   3  |  44842  |  14161 |  15483 |  14161 |  15198 |  15483 |  15483 |  15483 |
| carbon-load-partsupp |  23037.0 |   3  |  69111  |  21259 |  24620 |  21259 |  23232 |  24620 |  24620 |  24620 |
|  carbon-load-region  |  1076.0  |   3  |   3228  |   447  |  1878  |   447  |   903  |  1878  |  1878  |  1878  |
| carbon-load-supplier |  2460.0  |   3  |   7381  |  1310  |  4248  |  1310  |  1823  |  4248  |  4248  |  4248  |
+----------------------+----------+------+---------+--------+--------+--------+--------+--------+--------+--------+
+-------------------------+---------+------+--------+-------+-------+-------+-------+-------+-------+-------+
|          query          |   avg   | size |  total |  min  |  max  |  25%  |  50%  |  75%  |  90%  |  95%  |
+-------------------------+---------+------+--------+-------+-------+-------+-------+-------+-------+-------+
|           ALL           | 21740.0 |   6  | 130440 |  322  | 83230 |  1124 | 21033 | 22038 | 83230 | 83230 |
| carbon-compact-customer | 21033.0 |   1  |  21033 | 21033 | 21033 | 21033 | 21033 | 21033 | 21033 | 21033 |
|  carbon-compact-nation  |  1124.0 |   1  |  1124  |  1124 |  1124 |  1124 |  1124 |  1124 |  1124 |  1124 |
|   carbon-compact-part   | 22038.0 |   1  |  22038 | 22038 | 22038 | 22038 | 22038 | 22038 | 22038 | 22038 |
| carbon-compact-partsupp | 83230.0 |   1  |  83230 | 83230 | 83230 | 83230 | 83230 | 83230 | 83230 | 83230 |
|  carbon-compact-region  |  322.0  |   1  |   322  |  322  |  322  |  322  |  322  |  322  |  322  |  322  |
| carbon-compact-supplier |  2693.0 |   1  |  2693  |  2693 |  2693 |  2693 |  2693 |  2693 |  2693 |  2693 |
+-------------------------+---------+------+--------+-------+-------+-------+-------+-------+-------+-------+
xuchuanyin commented 5 years ago

image