search

davidkel / provision-performance

1 stars 0 forks source link

track some performance figures #60

Open davidkel opened 1 year ago

davidkel commented 1 year ago

Results of a theoretical maximum

+----------------+---------+------+-----------------+-----------------+-----------------+-----------------+------------------+
| Name           | Succ    | Fail | Send Rate (TPS) | Max Latency (s) | Min Latency (s) | Avg Latency (s) | Throughput (TPS) |
|----------------|---------|------|-----------------|-----------------|-----------------|-----------------|------------------|
| no-op-evaluate | 2160240 | 0    | 17917.3         | 0.34            | 0.00            | 0.05            | 17916.0          |
+----------------+---------+------+-----------------+-----------------+-----------------+-----------------+------------------+

but I managed better than this, but can't find the output

Results of a blind write of ~100 byte asset, 2 org 1 peer each, 1 orderer, EP(Org1 or Org2) with block cutting parameters of block_cut_time: 1s block_size: 50 preferred_max_bytes: 512 KB

2022.09.05-08:20:40.761 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 12260 Succ: 9498 Fail:0 Unfinished:2762
2022.09.05-08:20:45.743 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 27262 Succ: 24388 Fail:0 Unfinished:2874
2022.09.05-08:20:50.739 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 42265 Succ: 39691 Fail:0 Unfinished:2574
2022.09.05-08:20:55.753 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 57266 Succ: 54811 Fail:0 Unfinished:2455
2022.09.05-08:21:00.744 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 72269 Succ: 69984 Fail:0 Unfinished:2285
2022.09.05-08:21:05.745 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 87269 Succ: 85165 Fail:0 Unfinished:2104
2022.09.05-08:21:10.755 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 102271 Succ: 100104 Fail:0 Unfinished:2167
2022.09.05-08:21:15.751 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 117273 Succ: 115313 Fail:0 Unfinished:1960
2022.09.05-08:21:20.754 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 132277 Succ: 130277 Fail:0 Unfinished:2000
2022.09.05-08:21:25.756 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 147283 Succ: 145071 Fail:0 Unfinished:2212
2022.09.05-08:21:30.753 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 162290 Succ: 160137 Fail:0 Unfinished:2153
2022.09.05-08:21:35.751 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 177292 Succ: 175190 Fail:0 Unfinished:2102
2022.09.05-08:21:40.750 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 192296 Succ: 190351 Fail:0 Unfinished:1945
2022.09.05-08:21:45.752 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 207306 Succ: 205494 Fail:0 Unfinished:1812
2022.09.05-08:21:50.748 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 222307 Succ: 220552 Fail:0 Unfinished:1755
2022.09.05-08:21:55.759 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 237318 Succ: 235477 Fail:0 Unfinished:1841
2022.09.05-08:22:00.751 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 252319 Succ: 250136 Fail:0 Unfinished:2183
2022.09.05-08:22:05.758 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 267325 Succ: 265042 Fail:0 Unfinished:2283
2022.09.05-08:22:10.754 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 282332 Succ: 280122 Fail:0 Unfinished:2210
2022.09.05-08:22:15.758 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 297337 Succ: 295225 Fail:0 Unfinished:2112
2022.09.05-08:22:20.757 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 312347 Succ: 310081 Fail:0 Unfinished:2266
2022.09.05-08:22:25.755 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 327353 Succ: 325192 Fail:0 Unfinished:2161
2022.09.05-08:22:30.757 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 342364 Succ: 340418 Fail:0 Unfinished:1946
2022.09.05-08:22:35.757 info  [caliper] [default-observer]      [create-asset-100 Round 0 Transaction Info] - Submitted: 357371 Succ: 355530 Fail:0 Unfinished:1841
2022.09.05-08:22:42.615 info  [caliper] [default-observer]      Resetting txCount indicator count
2022.09.05-08:22:42.617 info  [caliper] [report-builder]        ### Test result ###
2022.09.05-08:22:42.626 info  [caliper] [report-builder]
+------------------+--------+------+-----------------+-----------------+-----------------+-----------------+------------------+
| Name             | Succ   | Fail | Send Rate (TPS) | Max Latency (s) | Min Latency (s) | Avg Latency (s) | Throughput (TPS) |
|------------------|--------|------|-----------------|-----------------|-----------------|-----------------|------------------|
| create-asset-100 | 360150 | 0    | 2996.2          | 2.04            | 0.28            | 0.73            | 2983.6           |
+------------------+--------+------+-----------------+-----------------+-----------------+-----------------+------------------+

read/write asset (fixed TPS 2750 read 1, write 1, same asset) - 1,000,000 assets preloaded. failures are MVCC_READ_CONFLICTS which are expected

2022.09.23-11:37:02.604 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 10893 Succ: 10549 Fail:4 Unfinished:340
2022.09.23-11:37:07.601 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 24426 Succ: 23988 Fail:9 Unfinished:429
2022.09.23-11:37:12.598 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 37946 Succ: 37648 Fail:11 Unfinished:287
2022.09.23-11:37:17.593 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 51449 Succ: 51173 Fail:12 Unfinished:264
2022.09.23-11:37:22.604 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 64950 Succ: 64782 Fail:13 Unfinished:155
2022.09.23-11:37:27.598 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 78450 Succ: 78281 Fail:14 Unfinished:155
2022.09.23-11:37:32.601 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 91950 Succ: 91640 Fail:18 Unfinished:292
2022.09.23-11:37:37.598 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 105450 Succ: 105185 Fail:20 Unfinished:245
2022.09.23-11:37:42.601 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 118950 Succ: 118779 Fail:21 Unfinished:150
2022.09.23-11:37:47.597 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 132450 Succ: 132276 Fail:23 Unfinished:151
2022.09.23-11:37:52.598 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 145950 Succ: 145771 Fail:25 Unfinished:154
2022.09.23-11:37:57.606 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 159450 Succ: 159254 Fail:25 Unfinished:171
2022.09.23-11:38:02.600 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 172954 Succ: 172771 Fail:25 Unfinished:158
2022.09.23-11:38:07.601 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 186454 Succ: 186272 Fail:26 Unfinished:156
2022.09.23-11:38:12.602 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 199955 Succ: 199653 Fail:30 Unfinished:272
2022.09.23-11:38:17.602 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 213460 Succ: 213273 Fail:32 Unfinished:155
2022.09.23-11:38:22.602 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 226964 Succ: 226777 Fail:32 Unfinished:155
2022.09.23-11:38:27.603 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 240468 Succ: 240271 Fail:33 Unfinished:164
2022.09.23-11:38:32.610 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 253973 Succ: 253788 Fail:35 Unfinished:150
2022.09.23-11:38:37.609 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 267476 Succ: 267261 Fail:37 Unfinished:178
2022.09.23-11:38:42.611 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 280980 Succ: 280770 Fail:39 Unfinished:171
2022.09.23-11:38:47.609 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 294485 Succ: 294297 Fail:40 Unfinished:148
2022.09.23-11:38:52.603 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 308020 Succ: 307811 Fail:40 Unfinished:169
2022.09.23-11:38:57.617 info  [caliper] [default-observer]      [read-write-assets-previously-read-100 Round 0 Transaction Info] - Submitted: 321526 Succ: 321007 Fail:43 Unfinished:476
2022.09.23-11:39:04.078 info  [caliper] [default-observer]      Resetting txCount indicator count
2022.09.23-11:39:04.080 info  [caliper] [report-builder]        ### Test result ###
2022.09.23-11:39:04.089 info  [caliper] [report-builder]
+---------------------------------------+--------+------+-----------------+-----------------+-----------------+-----------------+------------------+
| Name                                  | Succ   | Fail | Send Rate (TPS) | Max Latency (s) | Min Latency (s) | Avg Latency (s) | Throughput (TPS) |
|---------------------------------------|--------|------|-----------------|-----------------|-----------------|-----------------|------------------|
| read-write-assets-previously-read-100 | 324105 | 45   | 2696.4          | 0.51            | 0.03            | 0.09            | 2694.5           |
+---------------------------------------+--------+------+-----------------+-----------------+-----------------+-----------------+------------------+

note that performance degrades as the blockheight increases. this wasn't sustainable after a few performance runs also fixed-tps still performs better than transaction-load As only 1 channel could not get peer above ~65% cpu, locks within the peer appear to restrict the cpu from utilising the full capacity. More channels being used will allow the cpu to be used more

davidkel commented 1 year ago

Other notes: