search

YKG / hptc-shichendahai

2 stars 2 forks source link

sysbench oltp_update_index测试环境基准 #4

Open YKG opened 4 years ago

YKG commented 4 years ago

测试环境拓扑

IP 实例 配置
10.1.0.3 PD/TiDB 2C4G
172.17.0.7 TiKV 2C4G
172.17.0.8 TiKV 2C4G
172.17.0.9 TiKV 2C4G
YKG commented 4 years ago

下面的结果是在忘记将事务锁设为悲观锁的情况的测试情况

ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=128 run
...
[ 10s ] thds: 128 tps: 1570.75 qps: 1570.75 (r/w/o: 0.00/1570.75/0.00) lat (ms,95%): 150.29 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 128 tps: 1628.18 qps: 1628.18 (r/w/o: 0.00/1628.18/0.00) lat (ms,95%): 147.61 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 128 tps: 1583.09 qps: 1583.09 (r/w/o: 0.00/1583.09/0.00) lat (ms,95%): 155.80 err/s: 0.00 reconn/s: 0.00
[ 40s ] thds: 128 tps: 1598.10 qps: 1598.10 (r/w/o: 0.00/1598.10/0.00) lat (ms,95%): 161.51 err/s: 0.00 reconn/s: 0.00
[ 50s ] thds: 128 tps: 1486.30 qps: 1486.30 (r/w/o: 0.00/1486.30/0.00) lat (ms,95%): 176.73 err/s: 0.00 reconn/s: 0.00
^C
ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=64 run
...
[ 10s ] thds: 64 tps: 1334.50 qps: 1334.50 (r/w/o: 0.00/1334.50/0.00) lat (ms,95%): 69.29 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 64 tps: 1169.64 qps: 1169.64 (r/w/o: 0.00/1169.64/0.00) lat (ms,95%): 87.56 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 64 tps: 1204.70 qps: 1204.70 (r/w/o: 0.00/1204.70/0.00) lat (ms,95%): 77.19 err/s: 0.00 reconn/s: 0.00
[ 40s ] thds: 64 tps: 1220.61 qps: 1220.61 (r/w/o: 0.00/1220.61/0.00) lat (ms,95%): 80.03 err/s: 0.00 reconn/s: 0.00
[ 50s ] thds: 64 tps: 1206.89 qps: 1206.89 (r/w/o: 0.00/1206.89/0.00) lat (ms,95%): 80.03 err/s: 0.00 reconn/s: 0.00
[ 60s ] thds: 64 tps: 1248.39 qps: 1248.39 (r/w/o: 0.00/1248.39/0.00) lat (ms,95%): 82.96 err/s: 0.00 reconn/s: 0.00
^C
ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=32 run
...
[ 10s ] thds: 32 tps: 699.05 qps: 699.05 (r/w/o: 0.00/699.05/0.00) lat (ms,95%): 63.32 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 32 tps: 661.02 qps: 661.02 (r/w/o: 0.00/661.02/0.00) lat (ms,95%): 70.55 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 32 tps: 675.80 qps: 675.80 (r/w/o: 0.00/675.80/0.00) lat (ms,95%): 65.65 err/s: 0.00 reconn/s: 0.00
[ 40s ] thds: 32 tps: 689.90 qps: 689.90 (r/w/o: 0.00/689.90/0.00) lat (ms,95%): 68.05 err/s: 0.00 reconn/s: 0.00
[ 50s ] thds: 32 tps: 729.00 qps: 729.00 (r/w/o: 0.00/729.00/0.00) lat (ms,95%): 61.08 err/s: 0.00 reconn/s: 0.00
^C
ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=16 run
...
[ 10s ] thds: 16 tps: 419.10 qps: 419.10 (r/w/o: 0.00/419.10/0.00) lat (ms,95%): 56.84 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 16 tps: 398.61 qps: 398.61 (r/w/o: 0.00/398.61/0.00) lat (ms,95%): 57.87 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 16 tps: 368.20 qps: 368.20 (r/w/o: 0.00/368.20/0.00) lat (ms,95%): 68.05 err/s: 0.00 reconn/s: 0.00
[ 40s ] thds: 16 tps: 383.40 qps: 383.40 (r/w/o: 0.00/383.40/0.00) lat (ms,95%): 57.87 err/s: 0.00 reconn/s: 0.00
[ 50s ] thds: 16 tps: 403.10 qps: 403.10 (r/w/o: 0.00/403.10/0.00) lat (ms,95%): 53.85 err/s: 0.00 reconn/s: 0.00
^C
ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=8 run
...
[ 10s ] thds: 8 tps: 222.45 qps: 222.45 (r/w/o: 0.00/222.45/0.00) lat (ms,95%): 53.85 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 8 tps: 230.61 qps: 230.61 (r/w/o: 0.00/230.61/0.00) lat (ms,95%): 49.21 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 8 tps: 225.40 qps: 225.40 (r/w/o: 0.00/225.40/0.00) lat (ms,95%): 51.94 err/s: 0.00 reconn/s: 0.00
[ 40s ] thds: 8 tps: 233.00 qps: 233.00 (r/w/o: 0.00/233.00/0.00) lat (ms,95%): 48.34 err/s: 0.00 reconn/s: 0.00
[ 50s ] thds: 8 tps: 224.70 qps: 224.70 (r/w/o: 0.00/224.70/0.00) lat (ms,95%): 51.94 err/s: 0.00 reconn/s: 0.00
^C
ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=4 run
...
[ 10s ] thds: 4 tps: 129.87 qps: 129.87 (r/w/o: 0.00/129.87/0.00) lat (ms,95%): 46.63 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 4 tps: 130.21 qps: 130.21 (r/w/o: 0.00/130.21/0.00) lat (ms,95%): 46.63 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 4 tps: 137.10 qps: 137.10 (r/w/o: 0.00/137.10/0.00) lat (ms,95%): 44.98 err/s: 0.00 reconn/s: 0.00
[ 40s ] thds: 4 tps: 141.70 qps: 141.70 (r/w/o: 0.00/141.70/0.00) lat (ms,95%): 45.79 err/s: 0.00 reconn/s: 0.00
[ 50s ] thds: 4 tps: 141.70 qps: 141.70 (r/w/o: 0.00/141.70/0.00) lat (ms,95%): 41.85 err/s: 0.00 reconn/s: 0.00
^C
ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=2 run
...
[ 10s ] thds: 2 tps: 80.98 qps: 80.98 (r/w/o: 0.00/80.98/0.00) lat (ms,95%): 40.37 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 2 tps: 85.00 qps: 85.00 (r/w/o: 0.00/85.00/0.00) lat (ms,95%): 35.59 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 2 tps: 85.90 qps: 85.90 (r/w/o: 0.00/85.90/0.00) lat (ms,95%): 35.59 err/s: 0.00 reconn/s: 0.00
[ 40s ] thds: 2 tps: 86.70 qps: 86.70 (r/w/o: 0.00/86.70/0.00) lat (ms,95%): 38.25 err/s: 0.00 reconn/s: 0.00
[ 50s ] thds: 2 tps: 86.80 qps: 86.80 (r/w/o: 0.00/86.80/0.00) lat (ms,95%): 35.59 err/s: 0.00 reconn/s: 0.00
^C
ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=1 run
...
[ 10s ] thds: 1 tps: 58.39 qps: 58.39 (r/w/o: 0.00/58.39/0.00) lat (ms,95%): 26.20 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 1 tps: 54.20 qps: 54.20 (r/w/o: 0.00/54.20/0.00) lat (ms,95%): 28.16 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 1 tps: 56.80 qps: 56.80 (r/w/o: 0.00/56.80/0.00) lat (ms,95%): 27.17 err/s: 0.00 reconn/s: 0.00
[ 40s ] thds: 1 tps: 56.40 qps: 56.40 (r/w/o: 0.00/56.40/0.00) lat (ms,95%): 28.16 err/s: 0.00 reconn/s: 0.00
[ 50s ] thds: 1 tps: 51.30 qps: 51.30 (r/w/o: 0.00/51.30/0.00) lat (ms,95%): 30.81 err/s: 0.00 reconn/s: 0.00
^C
ubuntu@sh:~/hptc$ date
Sat Sep 19 20:49:37 CST 2020

ubuntu@sh:~/hptc$ date
Sat Sep 19 20:58:10 CST 2020
ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=512 run
sysbench 1.0.20 (using bundled LuaJIT 2.1.0-beta2)

Running the test with following options:
Number of threads: 512
Report intermediate results every 10 second(s)
Initializing random number generator from current time

Initializing worker threads...

Threads started!

FATAL: mysql_stmt_execute() returned error 9007 (Write conflict, txnStartTS=419566804903133260, conflictStartTS=419566804929347597, conflictCommitTS=0, key=t▒) for query 'UPDATE sbtest5 SET k=k+1 WHERE id=?'
FATAL: `thread_run' function failed: /usr/share/sysbench/oltp_common.lua:458: SQL error, errno = 9007, state = 'HY000': Write conflict, txnStartTS=419566804903133260, conflictStartTS=419566804929347597, conflictCommitTS=0, key=t▒
FATAL: mysql_stmt_execute() returned error 9007 (Write conflict, txnStartTS=419566805073526794, conflictStartTS=419566805060681742, conflictCommitTS=419566805073526809, key={tableID=81, indexID=1, indexValues={5710, 4989, }} primary={tableID=81, indexID=1, indexValues={5710, 4989, }} [try again later]) for query 'UPDATE sbtest8 SET k=k+1 WHERE id=?'
FATAL: `thread_run' function failed: /usr/share/sysbench/oltp_common.lua:458: SQL error, errno = 9007, state = 'HY000': Write conflict, txnStartTS=419566805073526794, conflictStartTS=419566805060681742, conflictCommitTS=419566805073526809, key={tableID=81, indexID=1, indexValues={5710, 4989, }} primary={tableID=81, indexID=1, indexValues={5710, 4989, }} [try again later]
ubuntu@sh:~/hptc$
YKG commented 4 years ago

悲观锁开启测试结果

ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=1 --time=30 run

[ 10s ] thds: 1 tps: 53.19 qps: 53.19 (r/w/o: 0.00/53.19/0.00) lat (ms,95%): 29.72 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 1 tps: 52.90 qps: 52.90 (r/w/o: 0.00/52.90/0.00) lat (ms,95%): 28.67 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 1 tps: 55.10 qps: 55.10 (r/w/o: 0.00/55.10/0.00) lat (ms,95%): 26.68 err/s: 0.00 reconn/s: 0.00

ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=2 --time=30 run

[ 10s ] thds: 2 tps: 88.18 qps: 88.18 (r/w/o: 0.00/88.18/0.00) lat (ms,95%): 33.12 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 2 tps: 87.00 qps: 87.00 (r/w/o: 0.00/87.00/0.00) lat (ms,95%): 34.95 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 2 tps: 87.10 qps: 87.10 (r/w/o: 0.00/87.10/0.00) lat (ms,95%): 35.59 err/s: 0.00 reconn/s: 0.00

ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=4 --time=30 run

[ 10s ] thds: 4 tps: 132.37 qps: 132.37 (r/w/o: 0.00/132.37/0.00) lat (ms,95%): 44.98 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 4 tps: 139.50 qps: 139.50 (r/w/o: 0.00/139.50/0.00) lat (ms,95%): 42.61 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 4 tps: 139.80 qps: 139.80 (r/w/o: 0.00/139.80/0.00) lat (ms,95%): 41.85 err/s: 0.00 reconn/s: 0.00

ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=8 --time=30 run

[ 10s ] thds: 8 tps: 239.95 qps: 239.95 (r/w/o: 0.00/239.95/0.00) lat (ms,95%): 46.63 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 8 tps: 235.00 qps: 235.00 (r/w/o: 0.00/235.00/0.00) lat (ms,95%): 49.21 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 8 tps: 222.20 qps: 222.20 (r/w/o: 0.00/222.20/0.00) lat (ms,95%): 51.94 err/s: 0.00 reconn/s: 0.00

ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=16 --time=30 run

[ 10s ] thds: 16 tps: 375.31 qps: 375.31 (r/w/o: 0.00/375.31/0.00) lat (ms,95%): 66.84 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 16 tps: 367.61 qps: 367.61 (r/w/o: 0.00/367.61/0.00) lat (ms,95%): 61.08 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 16 tps: 399.70 qps: 399.70 (r/w/o: 0.00/399.70/0.00) lat (ms,95%): 62.19 err/s: 0.00 reconn/s: 0.00

ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=32 --time=30 run

[ 10s ] thds: 32 tps: 670.25 qps: 670.25 (r/w/o: 0.00/670.25/0.00) lat (ms,95%): 73.13 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 32 tps: 708.32 qps: 708.32 (r/w/o: 0.00/708.32/0.00) lat (ms,95%): 66.84 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 32 tps: 662.80 qps: 662.80 (r/w/o: 0.00/662.80/0.00) lat (ms,95%): 75.82 err/s: 0.00 reconn/s: 0.00

ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=64 --time=30 run

[ 10s ] thds: 64 tps: 1145.52 qps: 1145.52 (r/w/o: 0.00/1145.52/0.00) lat (ms,95%): 90.78 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 64 tps: 1158.03 qps: 1158.03 (r/w/o: 0.00/1158.03/0.00) lat (ms,95%): 80.03 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 64 tps: 1214.71 qps: 1214.71 (r/w/o: 0.00/1214.71/0.00) lat (ms,95%): 78.60 err/s: 0.00 reconn/s: 0.00

ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=128 --time=30 run

[ 10s ] thds: 128 tps: 1760.80 qps: 1760.80 (r/w/o: 0.00/1760.80/0.00) lat (ms,95%): 155.80 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 128 tps: 1663.85 qps: 1663.85 (r/w/o: 0.00/1663.85/0.00) lat (ms,95%): 183.21 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 128 tps: 1682.50 qps: 1682.50 (r/w/o: 0.00/1682.50/0.00) lat (ms,95%): 176.73 err/s: 0.00 reconn/s: 0.00

ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=256 --time=30 run

[ 10s ] thds: 256 tps: 2181.60 qps: 2181.60 (r/w/o: 0.00/2181.60/0.00) lat (ms,95%): 376.49 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 256 tps: 1931.37 qps: 1931.37 (r/w/o: 0.00/1931.37/0.00) lat (ms,95%): 427.07 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 256 tps: 2269.70 qps: 2269.70 (r/w/o: 0.00/2269.70/0.00) lat (ms,95%): 369.77 err/s: 0.00 reconn/s: 0.00

ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=512 --time=30 run

[ 10s ] thds: 512 tps: 2187.75 qps: 2187.75 (r/w/o: 0.00/2187.75/0.00) lat (ms,95%): 669.89 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 512 tps: 2234.71 qps: 2234.71 (r/w/o: 0.00/2234.71/0.00) lat (ms,95%): 657.93 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 512 tps: 2403.69 qps: 2403.69 (r/w/o: 0.00/2403.69/0.00) lat (ms,95%): 634.66 err/s: 0.00 reconn/s: 0.00

ubuntu@sh:~/hptc$ sysbench --config-file=config oltp_update_index --tables=8 --table-size=10000 --threads=1024 --time=30 run
sysbench 1.0.20 (using bundled LuaJIT 2.1.0-beta2)

Running the test with following options:
Number of threads: 1024
Report intermediate results every 10 second(s)
Initializing random number generator from current time

Initializing worker threads...

FATAL: unable to connect to MySQL server on host '127.0.0.1', port 4000, aborting...
FATAL: error 2004: Can't create TCP/IP socket (24)
FATAL: `thread_init' function failed: /usr/share/sysbench/oltp_common.lua:349: connection creation failed
FATAL: Cannot find benchmark 'oltp_update_index': no such built-in test, file or module
(last message repeated 1 times)
FATAL: Thread initialization failed!
ubuntu@sh:~/hptc$ date
Sat Sep 19 21:10:34 CST 2020
YKG commented 4 years ago

以上是使用tiup启动的v4.0.6版本测试的，比赛要求中指定了固定hash的版本，后面再以比赛指定的版本做一次

YKG commented 4 years ago

按照16个表，每表100000行测试结果

ubuntu@sg:~/hptc$ date;./run.sh ;date
Sun Sep 20 12:05:55 UTC 2020
sysbench 1.0.20 (using bundled LuaJIT 2.1.0-beta2)

Running the test with following options:
Number of threads: 900
Report intermediate results every 1 second(s)
Initializing random number generator from current time

Initializing worker threads...

Threads started!

[ 1s ] thds: 900 tps: 3295.43 qps: 3295.43 (r/w/o: 0.00/3295.43/0.00) lat (ms,95%): 356.70 err/s: 0.00 reconn/s: 0.00
[ 2s ] thds: 900 tps: 6992.38 qps: 6992.38 (r/w/o: 0.00/6992.38/0.00) lat (ms,95%): 272.27 err/s: 0.00 reconn/s: 0.00
[ 3s ] thds: 900 tps: 7953.25 qps: 7953.25 (r/w/o: 0.00/7953.25/0.00) lat (ms,95%): 434.83 err/s: 0.00 reconn/s: 0.00
[ 4s ] thds: 900 tps: 9244.16 qps: 9244.16 (r/w/o: 0.00/9244.16/0.00) lat (ms,95%): 325.98 err/s: 0.00 reconn/s: 0.00
[ 5s ] thds: 900 tps: 9838.45 qps: 9838.45 (r/w/o: 0.00/9838.45/0.00) lat (ms,95%): 137.35 err/s: 0.00 reconn/s: 0.00
[ 6s ] thds: 900 tps: 3276.14 qps: 3276.14 (r/w/o: 0.00/3276.14/0.00) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
[ 7s ] thds: 900 tps: 6550.00 qps: 6550.00 (r/w/o: 0.00/6550.00/0.00) lat (ms,95%): 995.51 err/s: 0.00 reconn/s: 0.00
[ 8s ] thds: 900 tps: 3334.23 qps: 3334.23 (r/w/o: 0.00/3334.23/0.00) lat (ms,95%): 1280.93 err/s: 0.00 reconn/s: 0.00
[ 9s ] thds: 900 tps: 10859.93 qps: 10859.93 (r/w/o: 0.00/10859.93/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 10s ] thds: 900 tps: 8066.41 qps: 8066.41 (r/w/o: 0.00/8066.41/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 11s ] thds: 900 tps: 2776.78 qps: 2776.78 (r/w/o: 0.00/2776.78/0.00) lat (ms,95%): 95.81 err/s: 0.00 reconn/s: 0.00
[ 12s ] thds: 900 tps: 9095.04 qps: 9095.04 (r/w/o: 0.00/9095.04/0.00) lat (ms,95%): 1191.92 err/s: 0.00 reconn/s: 0.00
[ 13s ] thds: 900 tps: 10824.36 qps: 10824.36 (r/w/o: 0.00/10824.36/0.00) lat (ms,95%): 127.81 err/s: 0.00 reconn/s: 0.00
[ 14s ] thds: 900 tps: 9985.83 qps: 9985.83 (r/w/o: 0.00/9985.83/0.00) lat (ms,95%): 142.39 err/s: 0.00 reconn/s: 0.00
[ 15s ] thds: 900 tps: 9815.32 qps: 9815.32 (r/w/o: 0.00/9815.32/0.00) lat (ms,95%): 142.39 err/s: 0.00 reconn/s: 0.00
[ 16s ] thds: 900 tps: 10413.67 qps: 10414.67 (r/w/o: 0.00/10414.67/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 17s ] thds: 900 tps: 8898.87 qps: 8897.87 (r/w/o: 0.00/8897.87/0.00) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 18s ] thds: 900 tps: 932.88 qps: 932.88 (r/w/o: 0.00/932.88/0.00) lat (ms,95%): 56.84 err/s: 0.00 reconn/s: 0.00
[ 19s ] thds: 900 tps: 7891.36 qps: 7891.36 (r/w/o: 0.00/7891.36/0.00) lat (ms,95%): 1479.41 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 900 tps: 4466.55 qps: 4466.55 (r/w/o: 0.00/4466.55/0.00) lat (ms,95%): 144.97 err/s: 0.00 reconn/s: 0.00
[ 21s ] thds: 900 tps: 1053.62 qps: 1053.62 (r/w/o: 0.00/1053.62/0.00) lat (ms,95%): 1561.52 err/s: 0.00 reconn/s: 0.00
[ 22s ] thds: 900 tps: 1008.62 qps: 1008.62 (r/w/o: 0.00/1008.62/0.00) lat (ms,95%): 846.57 err/s: 0.00 reconn/s: 0.00
[ 23s ] thds: 900 tps: 3700.97 qps: 3700.97 (r/w/o: 0.00/3700.97/0.00) lat (ms,95%): 1589.90 err/s: 0.00 reconn/s: 0.00
[ 24s ] thds: 900 tps: 4440.40 qps: 4440.40 (r/w/o: 0.00/4440.40/0.00) lat (ms,95%): 101.13 err/s: 0.00 reconn/s: 0.00
[ 25s ] thds: 900 tps: 7838.39 qps: 7838.39 (r/w/o: 0.00/7838.39/0.00) lat (ms,95%): 1089.30 err/s: 0.00 reconn/s: 0.00
[ 26s ] thds: 900 tps: 10031.28 qps: 10031.28 (r/w/o: 0.00/10031.28/0.00) lat (ms,95%): 123.28 err/s: 0.00 reconn/s: 0.00
[ 27s ] thds: 900 tps: 6266.06 qps: 6266.06 (r/w/o: 0.00/6266.06/0.00) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
[ 28s ] thds: 900 tps: 8442.31 qps: 8442.31 (r/w/o: 0.00/8442.31/0.00) lat (ms,95%): 861.95 err/s: 0.00 reconn/s: 0.00
[ 29s ] thds: 900 tps: 9922.96 qps: 9922.96 (r/w/o: 0.00/9922.96/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 900 tps: 9828.03 qps: 9828.03 (r/w/o: 0.00/9828.03/0.00) lat (ms,95%): 144.97 err/s: 0.00 reconn/s: 0.00
[ 31s ] thds: 900 tps: 10640.38 qps: 10640.38 (r/w/o: 0.00/10640.38/0.00) lat (ms,95%): 127.81 err/s: 0.00 reconn/s: 0.00
[ 32s ] thds: 900 tps: 10479.21 qps: 10479.21 (r/w/o: 0.00/10479.21/0.00) lat (ms,95%): 125.52 err/s: 0.00 reconn/s: 0.00
[ 33s ] thds: 900 tps: 10217.02 qps: 10217.02 (r/w/o: 0.00/10217.02/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 34s ] thds: 900 tps: 9606.35 qps: 9606.35 (r/w/o: 0.00/9606.35/0.00) lat (ms,95%): 147.61 err/s: 0.00 reconn/s: 0.00
[ 35s ] thds: 900 tps: 1159.74 qps: 1159.74 (r/w/o: 0.00/1159.74/0.00) lat (ms,95%): 108.68 err/s: 0.00 reconn/s: 0.00
[ 36s ] thds: 900 tps: 1685.20 qps: 1685.20 (r/w/o: 0.00/1685.20/0.00) lat (ms,95%): 1903.57 err/s: 0.00 reconn/s: 0.00
[ 37s ] thds: 900 tps: 9532.17 qps: 9532.17 (r/w/o: 0.00/9532.17/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 38s ] thds: 900 tps: 1538.85 qps: 1538.85 (r/w/o: 0.00/1538.85/0.00) lat (ms,95%): 90.78 err/s: 0.00 reconn/s: 0.00
[ 39s ] thds: 900 tps: 7457.91 qps: 7457.91 (r/w/o: 0.00/7457.91/0.00) lat (ms,95%): 1479.41 err/s: 0.00 reconn/s: 0.00
[ 40s ] thds: 900 tps: 9834.11 qps: 9834.11 (r/w/o: 0.00/9834.11/0.00) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 41s ] thds: 900 tps: 5014.07 qps: 5014.07 (r/w/o: 0.00/5014.07/0.00) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 42s ] thds: 900 tps: 8353.15 qps: 8353.15 (r/w/o: 0.00/8353.15/0.00) lat (ms,95%): 1032.01 err/s: 0.00 reconn/s: 0.00
[ 43s ] thds: 900 tps: 10543.45 qps: 10543.45 (r/w/o: 0.00/10543.45/0.00) lat (ms,95%): 125.52 err/s: 0.00 reconn/s: 0.00
[ 44s ] thds: 900 tps: 9179.65 qps: 9179.65 (r/w/o: 0.00/9179.65/0.00) lat (ms,95%): 147.61 err/s: 0.00 reconn/s: 0.00
[ 45s ] thds: 900 tps: 10422.21 qps: 10422.21 (r/w/o: 0.00/10422.21/0.00) lat (ms,95%): 144.97 err/s: 0.00 reconn/s: 0.00
[ 46s ] thds: 900 tps: 10406.47 qps: 10406.47 (r/w/o: 0.00/10406.47/0.00) lat (ms,95%): 127.81 err/s: 0.00 reconn/s: 0.00
[ 47s ] thds: 900 tps: 9920.66 qps: 9920.66 (r/w/o: 0.00/9920.66/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 48s ] thds: 900 tps: 9811.03 qps: 9811.03 (r/w/o: 0.00/9811.03/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 49s ] thds: 900 tps: 2729.50 qps: 2729.50 (r/w/o: 0.00/2729.50/0.00) lat (ms,95%): 150.29 err/s: 0.00 reconn/s: 0.00
[ 50s ] thds: 900 tps: 776.99 qps: 776.99 (r/w/o: 0.00/776.99/0.00) lat (ms,95%): 1589.90 err/s: 0.00 reconn/s: 0.00
[ 51s ] thds: 900 tps: 7665.19 qps: 7665.19 (r/w/o: 0.00/7665.19/0.00) lat (ms,95%): 1109.09 err/s: 0.00 reconn/s: 0.00
[ 52s ] thds: 900 tps: 2410.41 qps: 2410.41 (r/w/o: 0.00/2410.41/0.00) lat (ms,95%): 74.46 err/s: 0.00 reconn/s: 0.00
[ 53s ] thds: 900 tps: 3610.67 qps: 3610.67 (r/w/o: 0.00/3610.67/0.00) lat (ms,95%): 1739.68 err/s: 0.00 reconn/s: 0.00
[ 54s ] thds: 900 tps: 1351.36 qps: 1351.36 (r/w/o: 0.00/1351.36/0.00) lat (ms,95%): 58.92 err/s: 0.00 reconn/s: 0.00
[ 55s ] thds: 900 tps: 992.20 qps: 992.20 (r/w/o: 0.00/992.20/0.00) lat (ms,95%): 2159.29 err/s: 0.00 reconn/s: 0.00
[ 56s ] thds: 900 tps: 3815.05 qps: 3815.05 (r/w/o: 0.00/3815.05/0.00) lat (ms,95%): 2493.86 err/s: 0.00 reconn/s: 0.00
[ 57s ] thds: 900 tps: 1841.18 qps: 1841.18 (r/w/o: 0.00/1841.18/0.00) lat (ms,95%): 1708.63 err/s: 0.00 reconn/s: 0.00
[ 58s ] thds: 900 tps: 3327.04 qps: 3327.04 (r/w/o: 0.00/3327.04/0.00) lat (ms,95%): 1678.14 err/s: 0.00 reconn/s: 0.00
[ 59s ] thds: 900 tps: 3954.11 qps: 3954.11 (r/w/o: 0.00/3954.11/0.00) lat (ms,95%): 1191.92 err/s: 0.00 reconn/s: 0.00
[ 60s ] thds: 900 tps: 743.04 qps: 743.04 (r/w/o: 0.00/743.04/0.00) lat (ms,95%): 1376.60 err/s: 0.00 reconn/s: 0.00
[ 61s ] thds: 900 tps: 125.97 qps: 125.97 (r/w/o: 0.00/125.97/0.00) lat (ms,95%): 1869.60 err/s: 0.00 reconn/s: 0.00
[ 62s ] thds: 900 tps: 1164.02 qps: 1164.02 (r/w/o: 0.00/1164.02/0.00) lat (ms,95%): 2238.47 err/s: 0.00 reconn/s: 0.00
[ 63s ] thds: 900 tps: 1014.04 qps: 1014.04 (r/w/o: 0.00/1014.04/0.00) lat (ms,95%): 995.51 err/s: 0.00 reconn/s: 0.00
[ 64s ] thds: 900 tps: 880.93 qps: 880.93 (r/w/o: 0.00/880.93/0.00) lat (ms,95%): 1401.61 err/s: 0.00 reconn/s: 0.00
[ 65s ] thds: 900 tps: 995.95 qps: 995.95 (r/w/o: 0.00/995.95/0.00) lat (ms,95%): 1258.08 err/s: 0.00 reconn/s: 0.00
[ 66s ] thds: 900 tps: 824.10 qps: 824.10 (r/w/o: 0.00/824.10/0.00) lat (ms,95%): 1258.08 err/s: 0.00 reconn/s: 0.00
[ 67s ] thds: 900 tps: 691.07 qps: 691.07 (r/w/o: 0.00/691.07/0.00) lat (ms,95%): 1618.78 err/s: 0.00 reconn/s: 0.00
[ 68s ] thds: 900 tps: 921.83 qps: 921.83 (r/w/o: 0.00/921.83/0.00) lat (ms,95%): 1533.66 err/s: 0.00 reconn/s: 0.00
[ 69s ] thds: 900 tps: 1521.11 qps: 1521.11 (r/w/o: 0.00/1521.11/0.00) lat (ms,95%): 1352.03 err/s: 0.00 reconn/s: 0.00
[ 70s ] thds: 900 tps: 790.66 qps: 790.66 (r/w/o: 0.00/790.66/0.00) lat (ms,95%): 909.80 err/s: 0.00 reconn/s: 0.00
[ 71s ] thds: 900 tps: 1479.93 qps: 1479.93 (r/w/o: 0.00/1479.93/0.00) lat (ms,95%): 1213.57 err/s: 0.00 reconn/s: 0.00
[ 72s ] thds: 900 tps: 1298.41 qps: 1298.41 (r/w/o: 0.00/1298.41/0.00) lat (ms,95%): 1050.76 err/s: 0.00 reconn/s: 0.00
[ 73s ] thds: 900 tps: 1447.67 qps: 1447.67 (r/w/o: 0.00/1447.67/0.00) lat (ms,95%): 995.51 err/s: 0.00 reconn/s: 0.00
[ 74s ] thds: 900 tps: 4197.49 qps: 4197.49 (r/w/o: 0.00/4197.49/0.00) lat (ms,95%): 995.51 err/s: 0.00 reconn/s: 0.00
[ 75s ] thds: 900 tps: 10355.86 qps: 10355.86 (r/w/o: 0.00/10355.86/0.00) lat (ms,95%): 176.73 err/s: 0.00 reconn/s: 0.00
[ 76s ] thds: 900 tps: 10776.03 qps: 10776.03 (r/w/o: 0.00/10776.03/0.00) lat (ms,95%): 127.81 err/s: 0.00 reconn/s: 0.00
[ 77s ] thds: 900 tps: 9846.43 qps: 9846.43 (r/w/o: 0.00/9846.43/0.00) lat (ms,95%): 127.81 err/s: 0.00 reconn/s: 0.00
[ 78s ] thds: 900 tps: 10152.73 qps: 10152.73 (r/w/o: 0.00/10152.73/0.00) lat (ms,95%): 147.61 err/s: 0.00 reconn/s: 0.00
[ 79s ] thds: 900 tps: 10728.05 qps: 10728.05 (r/w/o: 0.00/10728.05/0.00) lat (ms,95%): 127.81 err/s: 0.00 reconn/s: 0.00
[ 80s ] thds: 900 tps: 4792.66 qps: 4792.66 (r/w/o: 0.00/4792.66/0.00) lat (ms,95%): 137.35 err/s: 0.00 reconn/s: 0.00
[ 81s ] thds: 900 tps: 330.90 qps: 330.90 (r/w/o: 0.00/330.90/0.00) lat (ms,95%): 1618.78 err/s: 0.00 reconn/s: 0.00
[ 82s ] thds: 900 tps: 4943.82 qps: 4943.82 (r/w/o: 0.00/4943.82/0.00) lat (ms,95%): 2159.29 err/s: 0.00 reconn/s: 0.00
[ 83s ] thds: 900 tps: 4566.79 qps: 4566.79 (r/w/o: 0.00/4566.79/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 84s ] thds: 900 tps: 581.18 qps: 581.18 (r/w/o: 0.00/581.18/0.00) lat (ms,95%): 1213.57 err/s: 0.00 reconn/s: 0.00
[ 85s ] thds: 900 tps: 6434.91 qps: 6434.91 (r/w/o: 0.00/6434.91/0.00) lat (ms,95%): 2082.91 err/s: 0.00 reconn/s: 0.00
[ 86s ] thds: 900 tps: 9942.88 qps: 9942.88 (r/w/o: 0.00/9942.88/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 87s ] thds: 900 tps: 5659.26 qps: 5659.26 (r/w/o: 0.00/5659.26/0.00) lat (ms,95%): 893.56 err/s: 0.00 reconn/s: 0.00
[ 88s ] thds: 900 tps: 10479.32 qps: 10479.32 (r/w/o: 0.00/10479.32/0.00) lat (ms,95%): 144.97 err/s: 0.00 reconn/s: 0.00
[ 89s ] thds: 900 tps: 10122.41 qps: 10122.41 (r/w/o: 0.00/10122.41/0.00) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 90s ] thds: 900 tps: 9029.95 qps: 9029.95 (r/w/o: 0.00/9029.95/0.00) lat (ms,95%): 176.73 err/s: 0.00 reconn/s: 0.00
[ 91s ] thds: 900 tps: 6519.49 qps: 6519.49 (r/w/o: 0.00/6519.49/0.00) lat (ms,95%): 200.47 err/s: 0.00 reconn/s: 0.00
[ 92s ] thds: 900 tps: 10461.88 qps: 10461.88 (r/w/o: 0.00/10461.88/0.00) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
[ 93s ] thds: 900 tps: 10134.77 qps: 10134.77 (r/w/o: 0.00/10134.77/0.00) lat (ms,95%): 127.81 err/s: 0.00 reconn/s: 0.00
[ 94s ] thds: 900 tps: 10355.69 qps: 10355.69 (r/w/o: 0.00/10355.69/0.00) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
[ 95s ] thds: 900 tps: 6109.08 qps: 6109.08 (r/w/o: 0.00/6109.08/0.00) lat (ms,95%): 104.84 err/s: 0.00 reconn/s: 0.00
[ 96s ] thds: 900 tps: 223.03 qps: 222.03 (r/w/o: 0.00/222.03/0.00) lat (ms,95%): 1533.66 err/s: 0.00 reconn/s: 0.00
[ 97s ] thds: 900 tps: 8147.75 qps: 8148.75 (r/w/o: 0.00/8148.75/0.00) lat (ms,95%): 1561.52 err/s: 0.00 reconn/s: 0.00
[ 98s ] thds: 900 tps: 3528.61 qps: 3528.61 (r/w/o: 0.00/3528.61/0.00) lat (ms,95%): 1258.08 err/s: 0.00 reconn/s: 0.00
[ 99s ] thds: 900 tps: 10808.75 qps: 10808.75 (r/w/o: 0.00/10808.75/0.00) lat (ms,95%): 127.81 err/s: 0.00 reconn/s: 0.00
[ 100s ] thds: 900 tps: 6516.78 qps: 6516.78 (r/w/o: 0.00/6516.78/0.00) lat (ms,95%): 137.35 err/s: 0.00 reconn/s: 0.00
[ 101s ] thds: 900 tps: 1282.50 qps: 1282.50 (r/w/o: 0.00/1282.50/0.00) lat (ms,95%): 1618.78 err/s: 0.00 reconn/s: 0.00
[ 102s ] thds: 900 tps: 9068.33 qps: 9068.33 (r/w/o: 0.00/9068.33/0.00) lat (ms,95%): 1561.52 err/s: 0.00 reconn/s: 0.00
[ 103s ] thds: 900 tps: 4006.52 qps: 4006.52 (r/w/o: 0.00/4006.52/0.00) lat (ms,95%): 144.97 err/s: 0.00 reconn/s: 0.00
[ 104s ] thds: 900 tps: 4368.25 qps: 4368.25 (r/w/o: 0.00/4368.25/0.00) lat (ms,95%): 1561.52 err/s: 0.00 reconn/s: 0.00
[ 105s ] thds: 900 tps: 10082.02 qps: 10082.02 (r/w/o: 0.00/10082.02/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 106s ] thds: 900 tps: 2344.07 qps: 2344.07 (r/w/o: 0.00/2344.07/0.00) lat (ms,95%): 118.92 err/s: 0.00 reconn/s: 0.00
[ 107s ] thds: 900 tps: 1056.42 qps: 1056.42 (r/w/o: 0.00/1056.42/0.00) lat (ms,95%): 1803.47 err/s: 0.00 reconn/s: 0.00
[ 108s ] thds: 900 tps: 10196.94 qps: 10196.94 (r/w/o: 0.00/10196.94/0.00) lat (ms,95%): 144.97 err/s: 0.00 reconn/s: 0.00
[ 109s ] thds: 900 tps: 10210.34 qps: 10210.34 (r/w/o: 0.00/10210.34/0.00) lat (ms,95%): 144.97 err/s: 0.00 reconn/s: 0.00
[ 110s ] thds: 900 tps: 10640.01 qps: 10640.01 (r/w/o: 0.00/10640.01/0.00) lat (ms,95%): 123.28 err/s: 0.00 reconn/s: 0.00
[ 111s ] thds: 900 tps: 10653.18 qps: 10653.18 (r/w/o: 0.00/10653.18/0.00) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
[ 112s ] thds: 900 tps: 1969.19 qps: 1969.19 (r/w/o: 0.00/1969.19/0.00) lat (ms,95%): 153.02 err/s: 0.00 reconn/s: 0.00
[ 113s ] thds: 900 tps: 1152.50 qps: 1152.50 (r/w/o: 0.00/1152.50/0.00) lat (ms,95%): 1771.29 err/s: 0.00 reconn/s: 0.00
[ 114s ] thds: 900 tps: 5992.41 qps: 5992.41 (r/w/o: 0.00/5992.41/0.00) lat (ms,95%): 733.00 err/s: 0.00 reconn/s: 0.00
[ 115s ] thds: 900 tps: 894.22 qps: 894.22 (r/w/o: 0.00/894.22/0.00) lat (ms,95%): 926.33 err/s: 0.00 reconn/s: 0.00
[ 116s ] thds: 900 tps: 7076.32 qps: 7076.32 (r/w/o: 0.00/7076.32/0.00) lat (ms,95%): 1648.20 err/s: 0.00 reconn/s: 0.00
[ 117s ] thds: 900 tps: 10218.86 qps: 10218.86 (r/w/o: 0.00/10218.86/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 118s ] thds: 900 tps: 4601.87 qps: 4601.87 (r/w/o: 0.00/4601.87/0.00) lat (ms,95%): 73.13 err/s: 0.00 reconn/s: 0.00
[ 119s ] thds: 900 tps: 9572.33 qps: 9572.33 (r/w/o: 0.00/9572.33/0.00) lat (ms,95%): 1013.60 err/s: 0.00 reconn/s: 0.00
[ 120s ] thds: 900 tps: 10325.35 qps: 10325.35 (r/w/o: 0.00/10325.35/0.00) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
[ 121s ] thds: 900 tps: 10774.79 qps: 10774.79 (r/w/o: 0.00/10774.79/0.00) lat (ms,95%): 123.28 err/s: 0.00 reconn/s: 0.00
[ 122s ] thds: 900 tps: 9477.47 qps: 9477.47 (r/w/o: 0.00/9477.47/0.00) lat (ms,95%): 173.58 err/s: 0.00 reconn/s: 0.00
[ 123s ] thds: 900 tps: 10437.79 qps: 10437.79 (r/w/o: 0.00/10437.79/0.00) lat (ms,95%): 123.28 err/s: 0.00 reconn/s: 0.00
[ 124s ] thds: 900 tps: 10739.14 qps: 10739.14 (r/w/o: 0.00/10739.14/0.00) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 125s ] thds: 900 tps: 10500.74 qps: 10500.74 (r/w/o: 0.00/10500.74/0.00) lat (ms,95%): 125.52 err/s: 0.00 reconn/s: 0.00
[ 126s ] thds: 900 tps: 4086.83 qps: 4086.83 (r/w/o: 0.00/4086.83/0.00) lat (ms,95%): 137.35 err/s: 0.00 reconn/s: 0.00
[ 127s ] thds: 900 tps: 0.00 qps: 0.00 (r/w/o: 0.00/0.00/0.00) lat (ms,95%): 0.00 err/s: 0.00 reconn/s: 0.00
[ 128s ] thds: 900 tps: 6503.73 qps: 6503.73 (r/w/o: 0.00/6503.73/0.00) lat (ms,95%): 1771.29 err/s: 0.00 reconn/s: 0.00
[ 129s ] thds: 900 tps: 2521.26 qps: 2521.26 (r/w/o: 0.00/2521.26/0.00) lat (ms,95%): 1533.66 err/s: 0.00 reconn/s: 0.00
[ 130s ] thds: 900 tps: 10578.33 qps: 10578.33 (r/w/o: 0.00/10578.33/0.00) lat (ms,95%): 123.28 err/s: 0.00 reconn/s: 0.00
[ 131s ] thds: 900 tps: 7288.18 qps: 7288.18 (r/w/o: 0.00/7288.18/0.00) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
[ 132s ] thds: 900 tps: 1290.37 qps: 1290.37 (r/w/o: 0.00/1290.37/0.00) lat (ms,95%): 57.87 err/s: 0.00 reconn/s: 0.00
[ 133s ] thds: 900 tps: 6096.60 qps: 6096.60 (r/w/o: 0.00/6096.60/0.00) lat (ms,95%): 2009.23 err/s: 0.00 reconn/s: 0.00
[ 134s ] thds: 900 tps: 10195.21 qps: 10195.21 (r/w/o: 0.00/10195.21/0.00) lat (ms,95%): 153.02 err/s: 0.00 reconn/s: 0.00
[ 135s ] thds: 900 tps: 10740.22 qps: 10740.22 (r/w/o: 0.00/10740.22/0.00) lat (ms,95%): 125.52 err/s: 0.00 reconn/s: 0.00
[ 136s ] thds: 900 tps: 10631.62 qps: 10631.62 (r/w/o: 0.00/10631.62/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 137s ] thds: 900 tps: 3953.17 qps: 3953.17 (r/w/o: 0.00/3953.17/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 138s ] thds: 900 tps: 4560.07 qps: 4560.07 (r/w/o: 0.00/4560.07/0.00) lat (ms,95%): 1479.41 err/s: 0.00 reconn/s: 0.00
[ 139s ] thds: 900 tps: 9378.17 qps: 9378.17 (r/w/o: 0.00/9378.17/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 140s ] thds: 900 tps: 5540.61 qps: 5540.61 (r/w/o: 0.00/5540.61/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 141s ] thds: 900 tps: 113.95 qps: 113.95 (r/w/o: 0.00/113.95/0.00) lat (ms,95%): 1618.78 err/s: 0.00 reconn/s: 0.00
[ 142s ] thds: 900 tps: 9561.47 qps: 9561.47 (r/w/o: 0.00/9561.47/0.00) lat (ms,95%): 1589.90 err/s: 0.00 reconn/s: 0.00
[ 143s ] thds: 900 tps: 5299.21 qps: 5299.21 (r/w/o: 0.00/5299.21/0.00) lat (ms,95%): 137.35 err/s: 0.00 reconn/s: 0.00
[ 144s ] thds: 900 tps: 496.95 qps: 496.95 (r/w/o: 0.00/496.95/0.00) lat (ms,95%): 1533.66 err/s: 0.00 reconn/s: 0.00
[ 145s ] thds: 900 tps: 4263.13 qps: 4263.13 (r/w/o: 0.00/4263.13/0.00) lat (ms,95%): 2009.23 err/s: 0.00 reconn/s: 0.00
[ 146s ] thds: 900 tps: 2011.81 qps: 2011.81 (r/w/o: 0.00/2011.81/0.00) lat (ms,95%): 71.83 err/s: 0.00 reconn/s: 0.00
[ 147s ] thds: 900 tps: 9273.20 qps: 9273.20 (r/w/o: 0.00/9273.20/0.00) lat (ms,95%): 1213.57 err/s: 0.00 reconn/s: 0.00
[ 148s ] thds: 900 tps: 9364.97 qps: 9364.97 (r/w/o: 0.00/9364.97/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 149s ] thds: 900 tps: 4444.16 qps: 4444.16 (r/w/o: 0.00/4444.16/0.00) lat (ms,95%): 1170.65 err/s: 0.00 reconn/s: 0.00
[ 150s ] thds: 900 tps: 10333.19 qps: 10333.19 (r/w/o: 0.00/10333.19/0.00) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
[ 151s ] thds: 900 tps: 9753.22 qps: 9753.22 (r/w/o: 0.00/9753.22/0.00) lat (ms,95%): 142.39 err/s: 0.00 reconn/s: 0.00
[ 152s ] thds: 900 tps: 9958.32 qps: 9958.32 (r/w/o: 0.00/9958.32/0.00) lat (ms,95%): 153.02 err/s: 0.00 reconn/s: 0.00
[ 153s ] thds: 900 tps: 11051.61 qps: 11051.61 (r/w/o: 0.00/11051.61/0.00) lat (ms,95%): 127.81 err/s: 0.00 reconn/s: 0.00
[ 154s ] thds: 900 tps: 10317.65 qps: 10317.65 (r/w/o: 0.00/10317.65/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 155s ] thds: 900 tps: 9866.99 qps: 9866.99 (r/w/o: 0.00/9866.99/0.00) lat (ms,95%): 137.35 err/s: 0.00 reconn/s: 0.00
[ 156s ] thds: 900 tps: 10220.43 qps: 10220.43 (r/w/o: 0.00/10220.43/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 157s ] thds: 900 tps: 4817.99 qps: 4817.99 (r/w/o: 0.00/4817.99/0.00) lat (ms,95%): 101.13 err/s: 0.00 reconn/s: 0.00
[ 158s ] thds: 900 tps: 1729.76 qps: 1729.76 (r/w/o: 0.00/1729.76/0.00) lat (ms,95%): 1533.66 err/s: 0.00 reconn/s: 0.00
[ 159s ] thds: 900 tps: 3012.05 qps: 3012.05 (r/w/o: 0.00/3012.05/0.00) lat (ms,95%): 104.84 err/s: 0.00 reconn/s: 0.00
[ 160s ] thds: 900 tps: 10497.61 qps: 10497.61 (r/w/o: 0.00/10497.61/0.00) lat (ms,95%): 861.95 err/s: 0.00 reconn/s: 0.00
[ 161s ] thds: 900 tps: 8992.01 qps: 8992.01 (r/w/o: 0.00/8992.01/0.00) lat (ms,95%): 125.52 err/s: 0.00 reconn/s: 0.00
[ 162s ] thds: 900 tps: 5359.09 qps: 5359.09 (r/w/o: 0.00/5359.09/0.00) lat (ms,95%): 1109.09 err/s: 0.00 reconn/s: 0.00
[ 163s ] thds: 900 tps: 10300.16 qps: 10300.16 (r/w/o: 0.00/10300.16/0.00) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 164s ] thds: 900 tps: 9784.77 qps: 9784.77 (r/w/o: 0.00/9784.77/0.00) lat (ms,95%): 147.61 err/s: 0.00 reconn/s: 0.00
[ 165s ] thds: 900 tps: 10250.61 qps: 10250.61 (r/w/o: 0.00/10250.61/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 166s ] thds: 900 tps: 10843.61 qps: 10843.61 (r/w/o: 0.00/10843.61/0.00) lat (ms,95%): 137.35 err/s: 0.00 reconn/s: 0.00
[ 167s ] thds: 900 tps: 10287.64 qps: 10287.64 (r/w/o: 0.00/10287.64/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 168s ] thds: 900 tps: 9834.97 qps: 9834.97 (r/w/o: 0.00/9834.97/0.00) lat (ms,95%): 158.63 err/s: 0.00 reconn/s: 0.00
[ 169s ] thds: 900 tps: 7412.90 qps: 7412.90 (r/w/o: 0.00/7412.90/0.00) lat (ms,95%): 116.80 err/s: 0.00 reconn/s: 0.00
[ 170s ] thds: 900 tps: 537.90 qps: 537.90 (r/w/o: 0.00/537.90/0.00) lat (ms,95%): 1109.09 err/s: 0.00 reconn/s: 0.00
[ 171s ] thds: 900 tps: 7056.44 qps: 7056.44 (r/w/o: 0.00/7056.44/0.00) lat (ms,95%): 1618.78 err/s: 0.00 reconn/s: 0.00
[ 172s ] thds: 900 tps: 407.90 qps: 407.90 (r/w/o: 0.00/407.90/0.00) lat (ms,95%): 1280.93 err/s: 0.00 reconn/s: 0.00
[ 173s ] thds: 900 tps: 1443.36 qps: 1443.36 (r/w/o: 0.00/1443.36/0.00) lat (ms,95%): 2082.91 err/s: 0.00 reconn/s: 0.00
[ 174s ] thds: 900 tps: 10106.52 qps: 10106.52 (r/w/o: 0.00/10106.52/0.00) lat (ms,95%): 253.35 err/s: 0.00 reconn/s: 0.00
[ 175s ] thds: 900 tps: 353.13 qps: 353.13 (r/w/o: 0.00/353.13/0.00) lat (ms,95%): 114.72 err/s: 0.00 reconn/s: 0.00
[ 176s ] thds: 900 tps: 3546.70 qps: 3546.70 (r/w/o: 0.00/3546.70/0.00) lat (ms,95%): 1739.68 err/s: 0.00 reconn/s: 0.00
[ 177s ] thds: 900 tps: 7486.71 qps: 7486.71 (r/w/o: 0.00/7486.71/0.00) lat (ms,95%): 94.10 err/s: 0.00 reconn/s: 0.00
[ 178s ] thds: 900 tps: 9044.72 qps: 9044.72 (r/w/o: 0.00/9044.72/0.00) lat (ms,95%): 787.74 err/s: 0.00 reconn/s: 0.00
[ 179s ] thds: 900 tps: 10374.65 qps: 10374.65 (r/w/o: 0.00/10374.65/0.00) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
[ 180s ] thds: 900 tps: 10516.93 qps: 10516.93 (r/w/o: 0.00/10516.93/0.00) lat (ms,95%): 123.28 err/s: 0.00 reconn/s: 0.00
[ 181s ] thds: 900 tps: 10147.54 qps: 10147.54 (r/w/o: 0.00/10147.54/0.00) lat (ms,95%): 144.97 err/s: 0.00 reconn/s: 0.00
[ 182s ] thds: 900 tps: 9816.91 qps: 9816.91 (r/w/o: 0.00/9816.91/0.00) lat (ms,95%): 147.61 err/s: 0.00 reconn/s: 0.00
[ 183s ] thds: 900 tps: 10750.97 qps: 10750.97 (r/w/o: 0.00/10750.97/0.00) lat (ms,95%): 125.52 err/s: 0.00 reconn/s: 0.00
[ 184s ] thds: 900 tps: 10764.42 qps: 10764.42 (r/w/o: 0.00/10764.42/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 185s ] thds: 900 tps: 9817.86 qps: 9817.86 (r/w/o: 0.00/9817.86/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 186s ] thds: 900 tps: 1445.43 qps: 1445.43 (r/w/o: 0.00/1445.43/0.00) lat (ms,95%): 125.52 err/s: 0.00 reconn/s: 0.00
[ 187s ] thds: 900 tps: 3615.89 qps: 3615.89 (r/w/o: 0.00/3615.89/0.00) lat (ms,95%): 1708.63 err/s: 0.00 reconn/s: 0.00
[ 188s ] thds: 900 tps: 10675.58 qps: 10675.58 (r/w/o: 0.00/10675.58/0.00) lat (ms,95%): 125.52 err/s: 0.00 reconn/s: 0.00
[ 189s ] thds: 900 tps: 5601.53 qps: 5601.53 (r/w/o: 0.00/5601.53/0.00) lat (ms,95%): 137.35 err/s: 0.00 reconn/s: 0.00
[ 190s ] thds: 900 tps: 4201.14 qps: 4201.14 (r/w/o: 0.00/4201.14/0.00) lat (ms,95%): 1352.03 err/s: 0.00 reconn/s: 0.00
[ 191s ] thds: 900 tps: 10461.67 qps: 10461.67 (r/w/o: 0.00/10461.67/0.00) lat (ms,95%): 127.81 err/s: 0.00 reconn/s: 0.00
[ 192s ] thds: 900 tps: 10750.99 qps: 10750.99 (r/w/o: 0.00/10750.99/0.00) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 193s ] thds: 900 tps: 10674.59 qps: 10674.59 (r/w/o: 0.00/10674.59/0.00) lat (ms,95%): 127.81 err/s: 0.00 reconn/s: 0.00
[ 194s ] thds: 900 tps: 9584.27 qps: 9584.27 (r/w/o: 0.00/9584.27/0.00) lat (ms,95%): 150.29 err/s: 0.00 reconn/s: 0.00
[ 195s ] thds: 900 tps: 10711.96 qps: 10711.96 (r/w/o: 0.00/10711.96/0.00) lat (ms,95%): 123.28 err/s: 0.00 reconn/s: 0.00
[ 196s ] thds: 900 tps: 10603.12 qps: 10603.12 (r/w/o: 0.00/10603.12/0.00) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 197s ] thds: 900 tps: 10421.53 qps: 10421.53 (r/w/o: 0.00/10421.53/0.00) lat (ms,95%): 127.81 err/s: 0.00 reconn/s: 0.00
[ 198s ] thds: 900 tps: 5954.41 qps: 5954.41 (r/w/o: 0.00/5954.41/0.00) lat (ms,95%): 144.97 err/s: 0.00 reconn/s: 0.00
[ 199s ] thds: 900 tps: 14.00 qps: 14.00 (r/w/o: 0.00/14.00/0.00) lat (ms,95%): 24.83 err/s: 0.00 reconn/s: 0.00
[ 200s ] thds: 900 tps: 326.07 qps: 326.07 (r/w/o: 0.00/326.07/0.00) lat (ms,95%): 1771.29 err/s: 0.00 reconn/s: 0.00
[ 201s ] thds: 900 tps: 2823.03 qps: 2823.03 (r/w/o: 0.00/2823.03/0.00) lat (ms,95%): 3151.62 err/s: 0.00 reconn/s: 0.00
[ 202s ] thds: 900 tps: 6497.88 qps: 6497.88 (r/w/o: 0.00/6497.88/0.00) lat (ms,95%): 787.74 err/s: 0.00 reconn/s: 0.00
[ 203s ] thds: 900 tps: 7000.69 qps: 7000.69 (r/w/o: 0.00/7000.69/0.00) lat (ms,95%): 123.28 err/s: 0.00 reconn/s: 0.00
[ 204s ] thds: 900 tps: 1480.87 qps: 1480.87 (r/w/o: 0.00/1480.87/0.00) lat (ms,95%): 1352.03 err/s: 0.00 reconn/s: 0.00
[ 205s ] thds: 900 tps: 4842.85 qps: 4842.85 (r/w/o: 0.00/4842.85/0.00) lat (ms,95%): 1149.76 err/s: 0.00 reconn/s: 0.00
[ 206s ] thds: 900 tps: 5430.26 qps: 5430.26 (r/w/o: 0.00/5430.26/0.00) lat (ms,95%): 475.79 err/s: 0.00 reconn/s: 0.00
[ 207s ] thds: 900 tps: 4587.43 qps: 4587.43 (r/w/o: 0.00/4587.43/0.00) lat (ms,95%): 646.19 err/s: 0.00 reconn/s: 0.00
[ 208s ] thds: 900 tps: 5163.99 qps: 5163.99 (r/w/o: 0.00/5163.99/0.00) lat (ms,95%): 484.44 err/s: 0.00 reconn/s: 0.00
[ 209s ] thds: 900 tps: 3786.25 qps: 3786.25 (r/w/o: 0.00/3786.25/0.00) lat (ms,95%): 612.21 err/s: 0.00 reconn/s: 0.00
[ 210s ] thds: 900 tps: 38.01 qps: 38.01 (r/w/o: 0.00/38.01/0.00) lat (ms,95%): 1129.24 err/s: 0.00 reconn/s: 0.00
[ 211s ] thds: 900 tps: 2766.80 qps: 2766.80 (r/w/o: 0.00/2766.80/0.00) lat (ms,95%): 1648.20 err/s: 0.00 reconn/s: 0.00
[ 212s ] thds: 900 tps: 3148.96 qps: 3148.96 (r/w/o: 0.00/3148.96/0.00) lat (ms,95%): 458.96 err/s: 0.00 reconn/s: 0.00
[ 213s ] thds: 900 tps: 3316.53 qps: 3316.53 (r/w/o: 0.00/3316.53/0.00) lat (ms,95%): 442.73 err/s: 0.00 reconn/s: 0.00
[ 214s ] thds: 900 tps: 2824.46 qps: 2824.46 (r/w/o: 0.00/2824.46/0.00) lat (ms,95%): 434.83 err/s: 0.00 reconn/s: 0.00
[ 215s ] thds: 900 tps: 2755.25 qps: 2755.25 (r/w/o: 0.00/2755.25/0.00) lat (ms,95%): 520.62 err/s: 0.00 reconn/s: 0.00
[ 216s ] thds: 900 tps: 3456.40 qps: 3456.40 (r/w/o: 0.00/3456.40/0.00) lat (ms,95%): 450.77 err/s: 0.00 reconn/s: 0.00
[ 217s ] thds: 900 tps: 10052.90 qps: 10052.90 (r/w/o: 0.00/10052.90/0.00) lat (ms,95%): 179.94 err/s: 0.00 reconn/s: 0.00
[ 218s ] thds: 900 tps: 10016.52 qps: 10016.52 (r/w/o: 0.00/10016.52/0.00) lat (ms,95%): 142.39 err/s: 0.00 reconn/s: 0.00
[ 219s ] thds: 900 tps: 10887.61 qps: 10887.61 (r/w/o: 0.00/10887.61/0.00) lat (ms,95%): 123.28 err/s: 0.00 reconn/s: 0.00
[ 220s ] thds: 900 tps: 10383.36 qps: 10383.36 (r/w/o: 0.00/10383.36/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 221s ] thds: 900 tps: 1497.58 qps: 1497.58 (r/w/o: 0.00/1497.58/0.00) lat (ms,95%): 707.07 err/s: 0.00 reconn/s: 0.00
[ 222s ] thds: 900 tps: 5934.81 qps: 5934.81 (r/w/o: 0.00/5934.81/0.00) lat (ms,95%): 1327.91 err/s: 0.00 reconn/s: 0.00
[ 223s ] thds: 900 tps: 6007.93 qps: 6007.93 (r/w/o: 0.00/6007.93/0.00) lat (ms,95%): 861.95 err/s: 0.00 reconn/s: 0.00
[ 224s ] thds: 900 tps: 6816.97 qps: 6816.97 (r/w/o: 0.00/6816.97/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 225s ] thds: 900 tps: 2729.20 qps: 2729.20 (r/w/o: 0.00/2729.20/0.00) lat (ms,95%): 1258.08 err/s: 0.00 reconn/s: 0.00
[ 226s ] thds: 900 tps: 8494.42 qps: 8494.42 (r/w/o: 0.00/8494.42/0.00) lat (ms,95%): 161.51 err/s: 0.00 reconn/s: 0.00
[ 227s ] thds: 900 tps: 8835.86 qps: 8835.86 (r/w/o: 0.00/8835.86/0.00) lat (ms,95%): 179.94 err/s: 0.00 reconn/s: 0.00
[ 228s ] thds: 900 tps: 10303.37 qps: 10303.37 (r/w/o: 0.00/10303.37/0.00) lat (ms,95%): 153.02 err/s: 0.00 reconn/s: 0.00
[ 229s ] thds: 900 tps: 10400.51 qps: 10400.51 (r/w/o: 0.00/10400.51/0.00) lat (ms,95%): 127.81 err/s: 0.00 reconn/s: 0.00
[ 230s ] thds: 900 tps: 10260.00 qps: 10260.00 (r/w/o: 0.00/10260.00/0.00) lat (ms,95%): 144.97 err/s: 0.00 reconn/s: 0.00
[ 231s ] thds: 900 tps: 9576.36 qps: 9576.36 (r/w/o: 0.00/9576.36/0.00) lat (ms,95%): 155.80 err/s: 0.00 reconn/s: 0.00
[ 232s ] thds: 900 tps: 10790.02 qps: 10790.02 (r/w/o: 0.00/10790.02/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 233s ] thds: 900 tps: 10513.72 qps: 10513.72 (r/w/o: 0.00/10513.72/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 234s ] thds: 900 tps: 3147.05 qps: 3147.05 (r/w/o: 0.00/3147.05/0.00) lat (ms,95%): 112.67 err/s: 0.00 reconn/s: 0.00
[ 235s ] thds: 900 tps: 3081.25 qps: 3081.25 (r/w/o: 0.00/3081.25/0.00) lat (ms,95%): 1648.20 err/s: 0.00 reconn/s: 0.00
[ 236s ] thds: 900 tps: 5208.62 qps: 5208.62 (r/w/o: 0.00/5208.62/0.00) lat (ms,95%): 158.63 err/s: 0.00 reconn/s: 0.00
[ 237s ] thds: 900 tps: 317.72 qps: 317.72 (r/w/o: 0.00/317.72/0.00) lat (ms,95%): 1589.90 err/s: 0.00 reconn/s: 0.00
[ 238s ] thds: 900 tps: 393.16 qps: 393.16 (r/w/o: 0.00/393.16/0.00) lat (ms,95%): 2493.86 err/s: 0.00 reconn/s: 0.00
[ 239s ] thds: 900 tps: 8050.06 qps: 8050.06 (r/w/o: 0.00/8050.06/0.00) lat (ms,95%): 2632.28 err/s: 0.00 reconn/s: 0.00
[ 240s ] thds: 900 tps: 1148.75 qps: 1148.75 (r/w/o: 0.00/1148.75/0.00) lat (ms,95%): 458.96 err/s: 0.00 reconn/s: 0.00
[ 241s ] thds: 900 tps: 8379.12 qps: 8379.12 (r/w/o: 0.00/8379.12/0.00) lat (ms,95%): 1191.92 err/s: 0.00 reconn/s: 0.00
[ 242s ] thds: 900 tps: 9706.68 qps: 9706.68 (r/w/o: 0.00/9706.68/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 243s ] thds: 900 tps: 8766.65 qps: 8766.65 (r/w/o: 0.00/8766.65/0.00) lat (ms,95%): 164.45 err/s: 0.00 reconn/s: 0.00
[ 244s ] thds: 900 tps: 4601.70 qps: 4601.70 (r/w/o: 0.00/4601.70/0.00) lat (ms,95%): 186.54 err/s: 0.00 reconn/s: 0.00
[ 245s ] thds: 900 tps: 119.11 qps: 119.11 (r/w/o: 0.00/119.11/0.00) lat (ms,95%): 1648.20 err/s: 0.00 reconn/s: 0.00
[ 246s ] thds: 900 tps: 7508.75 qps: 7508.75 (r/w/o: 0.00/7508.75/0.00) lat (ms,95%): 1708.63 err/s: 0.00 reconn/s: 0.00
[ 247s ] thds: 900 tps: 7650.90 qps: 7650.90 (r/w/o: 0.00/7650.90/0.00) lat (ms,95%): 204.11 err/s: 0.00 reconn/s: 0.00
[ 248s ] thds: 900 tps: 7794.22 qps: 7794.22 (r/w/o: 0.00/7794.22/0.00) lat (ms,95%): 196.89 err/s: 0.00 reconn/s: 0.00
[ 249s ] thds: 900 tps: 1303.12 qps: 1303.12 (r/w/o: 0.00/1303.12/0.00) lat (ms,95%): 244.38 err/s: 0.00 reconn/s: 0.00
[ 250s ] thds: 900 tps: 1409.81 qps: 1409.81 (r/w/o: 0.00/1409.81/0.00) lat (ms,95%): 1836.24 err/s: 0.00 reconn/s: 0.00
[ 251s ] thds: 900 tps: 7031.74 qps: 7031.74 (r/w/o: 0.00/7031.74/0.00) lat (ms,95%): 356.70 err/s: 0.00 reconn/s: 0.00
[ 252s ] thds: 900 tps: 7725.32 qps: 7725.32 (r/w/o: 0.00/7725.32/0.00) lat (ms,95%): 200.47 err/s: 0.00 reconn/s: 0.00
[ 253s ] thds: 900 tps: 8369.31 qps: 8369.31 (r/w/o: 0.00/8369.31/0.00) lat (ms,95%): 200.47 err/s: 0.00 reconn/s: 0.00
[ 254s ] thds: 900 tps: 4642.69 qps: 4642.69 (r/w/o: 0.00/4642.69/0.00) lat (ms,95%): 186.54 err/s: 0.00 reconn/s: 0.00
[ 255s ] thds: 900 tps: 374.09 qps: 374.09 (r/w/o: 0.00/374.09/0.00) lat (ms,95%): 1352.03 err/s: 0.00 reconn/s: 0.00
[ 256s ] thds: 900 tps: 7712.47 qps: 7712.47 (r/w/o: 0.00/7712.47/0.00) lat (ms,95%): 1589.90 err/s: 0.00 reconn/s: 0.00
[ 257s ] thds: 900 tps: 2640.20 qps: 2640.20 (r/w/o: 0.00/2640.20/0.00) lat (ms,95%): 158.63 err/s: 0.00 reconn/s: 0.00
[ 258s ] thds: 900 tps: 6732.53 qps: 6732.53 (r/w/o: 0.00/6732.53/0.00) lat (ms,95%): 1109.09 err/s: 0.00 reconn/s: 0.00
[ 259s ] thds: 900 tps: 1411.04 qps: 1411.04 (r/w/o: 0.00/1411.04/0.00) lat (ms,95%): 211.60 err/s: 0.00 reconn/s: 0.00
[ 260s ] thds: 900 tps: 7762.49 qps: 7762.49 (r/w/o: 0.00/7762.49/0.00) lat (ms,95%): 1089.30 err/s: 0.00 reconn/s: 0.00
[ 261s ] thds: 900 tps: 8789.85 qps: 8789.85 (r/w/o: 0.00/8789.85/0.00) lat (ms,95%): 183.21 err/s: 0.00 reconn/s: 0.00
[ 262s ] thds: 900 tps: 9585.69 qps: 9585.69 (r/w/o: 0.00/9585.69/0.00) lat (ms,95%): 144.97 err/s: 0.00 reconn/s: 0.00
[ 263s ] thds: 900 tps: 10537.52 qps: 10536.52 (r/w/o: 0.00/10536.52/0.00) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 264s ] thds: 900 tps: 10303.35 qps: 10304.35 (r/w/o: 0.00/10304.35/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 265s ] thds: 900 tps: 10270.01 qps: 10269.01 (r/w/o: 0.00/10269.01/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 266s ] thds: 900 tps: 10947.52 qps: 10948.52 (r/w/o: 0.00/10948.52/0.00) lat (ms,95%): 125.52 err/s: 0.00 reconn/s: 0.00
[ 267s ] thds: 900 tps: 11021.43 qps: 11021.43 (r/w/o: 0.00/11021.43/0.00) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
[ 268s ] thds: 900 tps: 6156.01 qps: 6156.01 (r/w/o: 0.00/6156.01/0.00) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
[ 269s ] thds: 900 tps: 866.59 qps: 866.59 (r/w/o: 0.00/866.59/0.00) lat (ms,95%): 1561.52 err/s: 0.00 reconn/s: 0.00
[ 270s ] thds: 900 tps: 9443.97 qps: 9443.97 (r/w/o: 0.00/9443.97/0.00) lat (ms,95%): 142.39 err/s: 0.00 reconn/s: 0.00
[ 271s ] thds: 900 tps: 449.81 qps: 449.81 (r/w/o: 0.00/449.81/0.00) lat (ms,95%): 71.83 err/s: 0.00 reconn/s: 0.00
[ 272s ] thds: 900 tps: 335.15 qps: 335.15 (r/w/o: 0.00/335.15/0.00) lat (ms,95%): 2320.55 err/s: 0.00 reconn/s: 0.00
[ 273s ] thds: 900 tps: 7202.65 qps: 7202.65 (r/w/o: 0.00/7202.65/0.00) lat (ms,95%): 2082.91 err/s: 0.00 reconn/s: 0.00
[ 274s ] thds: 900 tps: 5600.15 qps: 5600.15 (r/w/o: 0.00/5600.15/0.00) lat (ms,95%): 977.74 err/s: 0.00 reconn/s: 0.00
[ 275s ] thds: 900 tps: 10224.44 qps: 10224.44 (r/w/o: 0.00/10224.44/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 276s ] thds: 900 tps: 10742.78 qps: 10742.78 (r/w/o: 0.00/10742.78/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 277s ] thds: 900 tps: 10793.06 qps: 10793.06 (r/w/o: 0.00/10793.06/0.00) lat (ms,95%): 118.92 err/s: 0.00 reconn/s: 0.00
[ 278s ] thds: 900 tps: 10635.77 qps: 10635.77 (r/w/o: 0.00/10635.77/0.00) lat (ms,95%): 127.81 err/s: 0.00 reconn/s: 0.00
[ 279s ] thds: 900 tps: 9903.02 qps: 9903.02 (r/w/o: 0.00/9903.02/0.00) lat (ms,95%): 144.97 err/s: 0.00 reconn/s: 0.00
[ 280s ] thds: 900 tps: 4055.62 qps: 4055.62 (r/w/o: 0.00/4055.62/0.00) lat (ms,95%): 114.72 err/s: 0.00 reconn/s: 0.00
[ 281s ] thds: 900 tps: 1187.87 qps: 1187.87 (r/w/o: 0.00/1187.87/0.00) lat (ms,95%): 1803.47 err/s: 0.00 reconn/s: 0.00
[ 282s ] thds: 900 tps: 9437.83 qps: 9437.83 (r/w/o: 0.00/9437.83/0.00) lat (ms,95%): 137.35 err/s: 0.00 reconn/s: 0.00
[ 283s ] thds: 900 tps: 10632.79 qps: 10632.79 (r/w/o: 0.00/10632.79/0.00) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
[ 284s ] thds: 900 tps: 1123.20 qps: 1123.20 (r/w/o: 0.00/1123.20/0.00) lat (ms,95%): 1069.86 err/s: 0.00 reconn/s: 0.00
[ 285s ] thds: 900 tps: 1142.67 qps: 1142.67 (r/w/o: 0.00/1142.67/0.00) lat (ms,95%): 2045.74 err/s: 0.00 reconn/s: 0.00
[ 286s ] thds: 900 tps: 1682.40 qps: 1682.40 (r/w/o: 0.00/1682.40/0.00) lat (ms,95%): 995.51 err/s: 0.00 reconn/s: 0.00
[ 287s ] thds: 900 tps: 2329.67 qps: 2329.67 (r/w/o: 0.00/2329.67/0.00) lat (ms,95%): 1739.68 err/s: 0.00 reconn/s: 0.00
[ 288s ] thds: 900 tps: 7428.74 qps: 7428.74 (r/w/o: 0.00/7428.74/0.00) lat (ms,95%): 114.72 err/s: 0.00 reconn/s: 0.00
[ 289s ] thds: 900 tps: 6383.29 qps: 6383.29 (r/w/o: 0.00/6383.29/0.00) lat (ms,95%): 802.05 err/s: 0.00 reconn/s: 0.00
[ 290s ] thds: 900 tps: 7240.23 qps: 7240.23 (r/w/o: 0.00/7240.23/0.00) lat (ms,95%): 646.19 err/s: 0.00 reconn/s: 0.00
[ 291s ] thds: 900 tps: 10434.94 qps: 10432.95 (r/w/o: 0.00/10432.95/0.00) lat (ms,95%): 137.35 err/s: 0.00 reconn/s: 0.00
[ 292s ] thds: 900 tps: 10792.14 qps: 10794.15 (r/w/o: 0.00/10794.15/0.00) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 293s ] thds: 900 tps: 10558.29 qps: 10558.29 (r/w/o: 0.00/10558.29/0.00) lat (ms,95%): 142.39 err/s: 0.00 reconn/s: 0.00
[ 294s ] thds: 900 tps: 10098.22 qps: 10098.22 (r/w/o: 0.00/10098.22/0.00) lat (ms,95%): 139.85 err/s: 0.00 reconn/s: 0.00
[ 295s ] thds: 900 tps: 10271.08 qps: 10271.08 (r/w/o: 0.00/10271.08/0.00) lat (ms,95%): 142.39 err/s: 0.00 reconn/s: 0.00
[ 296s ] thds: 900 tps: 10737.62 qps: 10737.62 (r/w/o: 0.00/10737.62/0.00) lat (ms,95%): 123.28 err/s: 0.00 reconn/s: 0.00
[ 297s ] thds: 900 tps: 10065.82 qps: 10065.82 (r/w/o: 0.00/10065.82/0.00) lat (ms,95%): 137.35 err/s: 0.00 reconn/s: 0.00
[ 298s ] thds: 900 tps: 4937.13 qps: 4937.13 (r/w/o: 0.00/4937.13/0.00) lat (ms,95%): 158.63 err/s: 0.00 reconn/s: 0.00
[ 299s ] thds: 900 tps: 874.67 qps: 874.67 (r/w/o: 0.00/874.67/0.00) lat (ms,95%): 1648.20 err/s: 0.00 reconn/s: 0.00
[ 300s ] thds: 900 tps: 9495.86 qps: 9495.86 (r/w/o: 0.00/9495.86/0.00) lat (ms,95%): 142.39 err/s: 0.00 reconn/s: 0.00
SQL statistics:
    queries performed:
        read:                            0
        write:                           1935380
        other:                           0
        total:                           1935380
    transactions:                        1935380 (6445.67 per sec.)
    queries:                             1935380 (6445.67 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)

General statistics:
    total time:                          300.2583s
    total number of events:              1935380

Latency (ms):
         min:                                   12.49
         avg:                                  139.54
         max:                                 5230.05
         95th percentile:                      325.98
         sum:                            270060646.86

Threads fairness:
    events (avg/stddev):           2150.4222/32.55
    execution time (avg/stddev):   300.0674/0.05

Sun Sep 20 12:10:57 UTC 2020
ubuntu@sg:~/hptc$

发现之前插入大量数据导致磁盘占用很大，上面是清理了磁盘后的测试情况

清理命令: tiup cluster clean aaa --all --ignore-role prometheus

磁盘测试数据磁盘占用情况

ubuntu@nodeq3rtm000006:~$ df -h
Filesystem      Size  Used Avail Use% Mounted on
udev            7.9G     0  7.9G   0% /dev
tmpfs           1.6G  1.1M  1.6G   1% /run
/dev/sdb1        29G  1.7G   28G   6% /
tmpfs           7.9G     0  7.9G   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           7.9G     0  7.9G   0% /sys/fs/cgroup
/dev/sdb15      105M  3.6M  101M   4% /boot/efi
/dev/sda1        32G   49M   30G   1% /mnt
tmpfs           1.6G     0  1.6G   0% /run/user/1000
ubuntu@nodeq3rtm000006:~$ date
Sun Sep 20 11:55:25 UTC 2020
ubuntu@nodeq3rtm000006:~$ echo "after prepare 16tables 100000rows" # 以上是初始磁盘，下面是准备完数据的情况
after prepare 16tables 100000rows
ubuntu@nodeq3rtm000006:~$ df -h
Filesystem      Size  Used Avail Use% Mounted on
udev            7.9G     0  7.9G   0% /dev
tmpfs           1.6G  1.3M  1.6G   1% /run
/dev/sdb1        29G  5.8G   24G  21% /
tmpfs           7.9G     0  7.9G   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           7.9G     0  7.9G   0% /sys/fs/cgroup
/dev/sdb15      105M  3.6M  101M   4% /boot/efi
/dev/sda1        32G   49M   30G   1% /mnt
tmpfs           1.6G     0  1.6G   0% /run/user/1000
ubuntu@nodeq3rtm000006:~$ htop # 下面是update_index执行结束磁盘占用
ubuntu@nodeq3rtm000006:~$ df -h
Filesystem      Size  Used Avail Use% Mounted on
udev            7.9G     0  7.9G   0% /dev
tmpfs           1.6G  1.3M  1.6G   1% /run
/dev/sdb1        29G  8.5G   21G  30% /
tmpfs           7.9G     0  7.9G   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           7.9G     0  7.9G   0% /sys/fs/cgroup
/dev/sdb15      105M  3.6M  101M   4% /boot/efi
/dev/sda1        32G   49M   30G   1% /mnt
tmpfs           1.6G     0  1.6G   0% /run/user/1000
ubuntu@nodeq3rtm000006:~$ Connection to kv1 closed by remote host.
Connection to kv1 closed.
ubuntu@sg:~$
liufuyang commented 4 years ago

所以官方那边4.0 900thread 是 20339 qps, 70.5ms latency (95%). 你这边硬件结果是 900thread, 6445 qps, 325ms latency(95%)?

我怎么看官方文档那边是1000万行数据, 咱们这才10万行数据. 但估计qps 和latency在硬件一样的情况下应该有一个稍微较好一点点的分数吧. 感觉qps 和latency对与数据量变化不是特别敏感才对.

YKG commented 4 years ago

测试环境拓扑

IP 实例 配置
172.29.3.187 PD/TiDB 8C32G, 894G NVMe, 阿里云青岛ecs.i2g.2xlarge
172.29.3.188 TiKV 8C32G, 894G NVMe, 阿里云青岛ecs.i2g.2xlarge
172.29.3.189 TiKV 8C32G, 894G NVMe, 阿里云青岛ecs.i2g.2xlarge
172.29.3.190 TiKV 8C32G, 894G NVMe, 阿里云青岛ecs.i2g.2xlarge

--threads=900 run --tables=16 --table-size=1000000的结果是14602.80QPS, 132.49ms latency(95%)

Started cluster `aaa` successfully
Start sysbench oltp_common --config-file=config prepare --tables=16 --table-size=1000000
Filesystem      Size  Used Avail Use% Mounted on
udev             16G     0   16G   0% /dev
tmpfs           3.2G  736K  3.2G   1% /run
/dev/vda1        40G  4.2G   34G  12% /
tmpfs            16G     0   16G   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs            16G     0   16G   0% /sys/fs/cgroup
tmpfs           3.2G     0  3.2G   0% /run/user/0
/dev/vdb        879G  683M  834G   1% /ssd
tmpfs           3.2G     0  3.2G   0% /run/user/1000
Mon 21 Sep 2020 09:26:05 AM CST
sysbench 1.0.20 (using bundled LuaJIT 2.1.0-beta2)

Initializing worker threads...

Creating table 'sbtest4'...
Creating table 'sbtest15'...
Creating table 'sbtest2'...
Creating table 'sbtest8'...
Creating table 'sbtest7'...
Creating table 'sbtest14'...
Creating table 'sbtest3'...
Creating table 'sbtest10'...
Creating table 'sbtest9'...
Creating table 'sbtest12'...
Creating table 'sbtest16'...
Creating table 'sbtest6'...
Creating table 'sbtest13'...
Creating table 'sbtest5'...
Creating table 'sbtest11'...
Creating table 'sbtest1'...
Inserting 1000000 records into 'sbtest15'
Inserting 1000000 records into 'sbtest5'
Inserting 1000000 records into 'sbtest7'
Inserting 1000000 records into 'sbtest14'
Inserting 1000000 records into 'sbtest11'
Inserting 1000000 records into 'sbtest9'
Inserting 1000000 records into 'sbtest1'
Inserting 1000000 records into 'sbtest10'
Inserting 1000000 records into 'sbtest8'
Inserting 1000000 records into 'sbtest6'
Inserting 1000000 records into 'sbtest2'
Inserting 1000000 records into 'sbtest16'
Inserting 1000000 records into 'sbtest13'
Inserting 1000000 records into 'sbtest4'
Inserting 1000000 records into 'sbtest3'
Inserting 1000000 records into 'sbtest12'
Creating a secondary index on 'sbtest4'...
Creating a secondary index on 'sbtest8'...
Creating a secondary index on 'sbtest10'...
Creating a secondary index on 'sbtest7'...
Creating a secondary index on 'sbtest15'...
Creating a secondary index on 'sbtest9'...
Creating a secondary index on 'sbtest5'...
Creating a secondary index on 'sbtest1'...
Creating a secondary index on 'sbtest16'...
Creating a secondary index on 'sbtest6'...
Creating a secondary index on 'sbtest11'...
Creating a secondary index on 'sbtest2'...
Creating a secondary index on 'sbtest3'...
Creating a secondary index on 'sbtest12'...
Creating a secondary index on 'sbtest14'...
Creating a secondary index on 'sbtest13'...

real    9m52.206s
user    0m32.793s
sys     0m1.815s
Mon 21 Sep 2020 09:35:57 AM CST
Filesystem      Size  Used Avail Use% Mounted on
udev             16G     0   16G   0% /dev
tmpfs           3.2G  728K  3.2G   1% /run
/dev/vda1        40G  4.2G   34G  12% /
tmpfs            16G     0   16G   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs            16G     0   16G   0% /sys/fs/cgroup
tmpfs           3.2G     0  3.2G   0% /run/user/0
/dev/vdb        879G  711M  834G   1% /ssd
Prepare done
Start sysbench oltp_update_index --config-file=config --threads=900 run --tables=16 --table-size=1000000
Filesystem      Size  Used Avail Use% Mounted on
udev             16G     0   16G   0% /dev
tmpfs           3.2G  728K  3.2G   1% /run
/dev/vda1        40G  4.2G   34G  12% /
tmpfs            16G     0   16G   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs            16G     0   16G   0% /sys/fs/cgroup
tmpfs           3.2G     0  3.2G   0% /run/user/0
/dev/vdb        879G  711M  834G   1% /ssd
Mon 21 Sep 2020 09:35:57 AM CST
sysbench 1.0.20 (using bundled LuaJIT 2.1.0-beta2)

Running the test with following options:
Number of threads: 900
Report intermediate results every 10 second(s)
Initializing random number generator from current time

Initializing worker threads...

Threads started!

[ 10s ] thds: 900 tps: 13774.02 qps: 13774.02 (r/w/o: 0.00/13769.23/4.80) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 900 tps: 14866.57 qps: 14866.57 (r/w/o: 0.00/14860.77/5.80) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 900 tps: 14968.73 qps: 14968.73 (r/w/o: 0.00/14962.33/6.40) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 40s ] thds: 900 tps: 14974.44 qps: 14974.44 (r/w/o: 0.00/14968.84/5.60) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 50s ] thds: 900 tps: 14744.86 qps: 14744.86 (r/w/o: 0.00/14738.36/6.50) lat (ms,95%): 130.13 err/s: 0.00 reconn/s: 0.00
[ 60s ] thds: 900 tps: 14882.39 qps: 14882.39 (r/w/o: 0.00/14875.39/7.00) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 70s ] thds: 900 tps: 14426.50 qps: 14426.50 (r/w/o: 0.00/14420.10/6.40) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
[ 80s ] thds: 900 tps: 14817.20 qps: 14817.20 (r/w/o: 0.00/14812.00/5.20) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 90s ] thds: 900 tps: 14699.38 qps: 14699.38 (r/w/o: 0.00/14693.18/6.20) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 100s ] thds: 900 tps: 14736.37 qps: 14736.27 (r/w/o: 0.00/14730.17/6.10) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 110s ] thds: 900 tps: 14465.94 qps: 14466.04 (r/w/o: 0.00/14460.24/5.80) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
[ 120s ] thds: 900 tps: 14541.82 qps: 14541.82 (r/w/o: 0.00/14536.82/5.00) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 130s ] thds: 900 tps: 14529.53 qps: 14529.53 (r/w/o: 0.00/14523.03/6.50) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
[ 140s ] thds: 900 tps: 14301.69 qps: 14301.69 (r/w/o: 0.00/14296.89/4.80) lat (ms,95%): 132.49 err/s: 0.00 reconn/s: 0.00
[ 150s ] thds: 900 tps: 14507.21 qps: 14507.21 (r/w/o: 0.00/14500.11/7.10) lat (ms,95%): 134.90 err/s: 0.00 reconn/s: 0.00
SQL statistics:
    queries performed:
        read:                            0
        write:                           2192405
        other:                           892
        total:                           2193297
    transactions:                        2193297 (14602.80 per sec.)
    queries:                             2193297 (14602.80 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)

General statistics:
    total time:                          150.1954s
    total number of events:              2193297

Latency (ms):
         min:                                    1.52
         avg:                                   61.57
         max:                                 3340.25
         95th percentile:                      132.49
         sum:                            135043163.06

Threads fairness:
    events (avg/stddev):           2436.9967/13.60
    execution time (avg/stddev):   150.0480/0.05

real    2m31.453s
user    0m35.892s
sys     0m43.086s
Mon 21 Sep 2020 09:38:29 AM CST
Filesystem      Size  Used Avail Use% Mounted on
udev             16G     0   16G   0% /dev
tmpfs           3.2G  728K  3.2G   1% /run
/dev/vda1        40G  4.2G   34G  12% /
tmpfs            16G     0   16G   0% /dev/shm
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs            16G     0   16G   0% /sys/fs/cgroup
tmpfs           3.2G     0  3.2G   0% /run/user/0
/dev/vdb        879G  730M  834G   1% /ssd
Run done
root@node3:~#
liufuyang commented 4 years ago

快接近官方那个测试的结果了哈. 我看那文档还提到说分别对每个表执行 analyze table 命令. 这步操作有区别么? 你也在测试前执行了?

YKG commented 4 years ago

快接近官方那个测试的结果了哈. 我看那文档还提到说分别对每个表执行 analyze table 命令. 这步操作有区别么? 你也在测试前执行了?

我不知道啊，不仅这个，我也没有预热。只是我看实际跑的情况，从第一条到最后一条全都是差异不大，所以估计也没啥影响。另外上面的测试还是100w数量级，比官方文档里的1000w少一个数量级。100w的数据准备时间要10min，1000w估计导入要100min，就没测

liufuyang commented 4 years ago

嗯嗯, 不需要用那么大数据先. 十万行应该可以了. 不行完了再问问导师测前是否需要跑analyze table (估计差异不大)