search

web3labs / crux

Data Privacy for Quorum Blockchains
https://www.web3labs.com
Apache License 2.0
53 stars 28 forks source link

4nodes quorum-example ? #27

Open drandreaskrueger opened 6 years ago

drandreaskrueger commented 6 years ago

[ old title was: "docker compose command after parameter changes?" ]

Thx a lot for your dockerized version, perhaps that helps us to get to higher rates than the ~200 TPS that I have been seeing in my recent benchmarks.

However, I am only seeing ~175 TPS for now, because in your setup

(a) the gasLimit is too low, see chainhammer quorum-IBFT.md #higher-gas-limit, and

(b) the txpool is too small, see chainhammer quorum-IBFT.md #mempool-settings

In the comment below you'll see the effects of those 2 too small parameters, when running your crux docker compose ...

? -->

What exactly do I have to do, after changing istanbul-genesis.json#L17 and in istanbul-start.sh#L11 ...

... by which exact command do I replace the docker-compose command from there? Thanks.

drandreaskrueger commented 6 years ago

blocks 131 - ... = TPS maxing out because of too low gasLimit

blocks 191 - ... = only 1 validator keeps sealing txs because of too small txpool

./tps.py 

versions: web3 4.3.0, py-solc: 2.1.0, solc 0.4.23+commit.124ca40d.Linux.gpp, testrpc 1.3.4, python 3.5.3 (default, Jan 19 2017, 14:11:04) [GCC 6.3.0 20170118]
web3 connection established, blockNumber = 84, node version string =  Geth/v1.7.2-stable-d7e3ff5b/linux-amd64/go1.10.1
first account of node is 0xcA843569e3427144cEad5e4d5999a3D0cCF92B8e, balance is 1000000000 Ether
nodeName: Quorum, nodeType: Geth, consensus: istanbul, chainName: ???

Block  84  - waiting for something to happen
(filedate 1534171683) last contract address: 0x1932c48b2bF8102Ba33B4A6B545C32236e342f34
(filedate 1534414963) new contract address: 0x1932c48b2bF8102Ba33B4A6B545C32236e342f34

starting timer, at block 129 which has  1  transactions; at timecode 8501.17258911
block 129 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX    1 /  0.9 s =   1.1 TPS_average
block 130 | new #TX  97 / 1000 ms =  97.0 TPS_current | total: #TX   98 /  2.1 s =  45.7 TPS_average
block 131 | new #TX 179 / 1000 ms = 179.0 TPS_current | total: #TX  277 /  3.1 s =  90.4 TPS_average
block 132 | new #TX 179 / 1000 ms = 179.0 TPS_current | total: #TX  456 /  4.0 s = 114.3 TPS_average
block 133 | new #TX 179 / 1000 ms = 179.0 TPS_current | total: #TX  635 /  4.9 s = 129.1 TPS_average
block 134 | new #TX 179 / 1000 ms = 179.0 TPS_current | total: #TX  814 /  6.1 s = 132.5 TPS_average
block 135 | new #TX 179 / 1000 ms = 179.0 TPS_current | total: #TX  993 /  7.1 s = 140.5 TPS_average
block 136 | new #TX 179 / 1000 ms = 179.0 TPS_current | total: #TX 1172 /  8.0 s = 146.4 TPS_average
block 137 | new #TX 179 / 1000 ms = 179.0 TPS_current | total: #TX 1351 /  9.0 s = 150.8 TPS_average
block 138 | new #TX 179 / 1000 ms = 179.0 TPS_current | total: #TX 1530 / 10.2 s = 150.2 TPS_average
block 139 | new #TX 179 / 1000 ms = 179.0 TPS_current | total: #TX 1709 / 11.1 s = 153.7 TPS_average
block 140 | new #TX 179 / 1000 ms = 179.0 TPS_current | total: #TX 1888 / 12.0 s = 156.8 TPS_average
block 141 | new #TX 179 / 1000 ms = 179.0 TPS_current | total: #TX 2067 / 13.0 s = 159.0 TPS_average
block 142 | new #TX 179 / 1000 ms = 179.0 TPS_current | total: #TX 2246 / 14.2 s = 157.7 TPS_average
block 143 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 2426 / 15.2 s = 160.0 TPS_average
block 144 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 2606 / 16.1 s = 162.0 TPS_average
block 145 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 2786 / 17.0 s = 163.8 TPS_average
block 146 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 2966 / 18.2 s = 162.6 TPS_average
block 147 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 3146 / 19.2 s = 164.1 TPS_average
block 148 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 3326 / 20.1 s = 165.5 TPS_average
block 149 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 3506 / 21.0 s = 166.8 TPS_average
block 150 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 3686 / 22.0 s = 167.9 TPS_average
block 151 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 3866 / 23.2 s = 166.7 TPS_average
block 152 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 4046 / 24.1 s = 167.8 TPS_average
block 153 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 4226 / 25.0 s = 168.8 TPS_average
block 154 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 4406 / 26.3 s = 167.8 TPS_average
block 155 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 4586 / 27.2 s = 168.7 TPS_average
block 156 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 4766 / 28.1 s = 169.6 TPS_average
block 157 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 4946 / 29.0 s = 170.4 TPS_average
block 158 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 5126 / 30.0 s = 171.1 TPS_average
block 159 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 5306 / 31.2 s = 170.1 TPS_average
block 160 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 5486 / 32.1 s = 170.8 TPS_average
block 161 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 5666 / 33.0 s = 171.5 TPS_average
block 162 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 5846 / 34.0 s = 172.1 TPS_average
block 163 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 6026 / 35.2 s = 171.2 TPS_average
block 164 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 6206 / 36.1 s = 171.8 TPS_average
block 165 | new #TX 180 / 1000 ms = 180.0 TPS_current | total: #TX 6386 / 37.1 s = 172.3 TPS_average
block 166 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 6567 / 38.0 s = 172.9 TPS_average
block 167 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 6748 / 39.2 s = 172.1 TPS_average
block 168 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 6929 / 40.1 s = 172.6 TPS_average
block 169 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 7110 / 41.1 s = 173.1 TPS_average
block 170 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 7291 / 42.0 s = 173.6 TPS_average
block 171 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 7472 / 43.2 s = 172.8 TPS_average
block 172 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 7653 / 44.2 s = 173.3 TPS_average
block 173 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 7834 / 45.1 s = 173.7 TPS_average
block 174 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 8015 / 46.0 s = 174.2 TPS_average
block 175 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 8196 / 47.2 s = 173.5 TPS_average
block 176 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 8377 / 48.2 s = 173.9 TPS_average
block 177 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 8558 / 49.1 s = 174.3 TPS_average
block 178 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 8739 / 50.0 s = 174.7 TPS_average
block 179 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 8920 / 51.0 s = 175.1 TPS_average
block 180 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 9101 / 52.2 s = 174.4 TPS_average
block 181 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 9282 / 53.1 s = 174.8 TPS_average
block 182 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 9463 / 54.0 s = 175.1 TPS_average
block 183 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 9644 / 55.0 s = 175.5 TPS_average
block 184 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 9825 / 56.2 s = 174.9 TPS_average
block 185 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 10006 / 57.1 s = 175.2 TPS_average
block 186 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 10187 / 58.0 s = 175.5 TPS_average
block 187 | new #TX 181 / 1000 ms = 181.0 TPS_current | total: #TX 10368 / 59.0 s = 175.8 TPS_average
block 188 | new #TX 182 / 1000 ms = 182.0 TPS_current | total: #TX 10550 / 60.2 s = 175.2 TPS_average
block 189 | new #TX 182 / 1000 ms = 182.0 TPS_current | total: #TX 10732 / 61.1 s = 175.5 TPS_average
block 190 | new #TX 112 / 1000 ms = 112.0 TPS_current | total: #TX 10844 / 62.1 s = 174.7 TPS_average
block 191 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 10844 / 63.0 s = 172.2 TPS_average
block 192 | new #TX 182 / 1000 ms = 182.0 TPS_current | total: #TX 11026 / 64.2 s = 171.7 TPS_average
block 193 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11026 / 65.1 s = 169.3 TPS_average
block 194 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11026 / 66.0 s = 166.9 TPS_average
block 195 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11026 / 67.0 s = 164.7 TPS_average
block 196 | new #TX 182 / 1000 ms = 182.0 TPS_current | total: #TX 11208 / 68.2 s = 164.3 TPS_average
block 197 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11208 / 69.1 s = 162.1 TPS_average
block 198 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11208 / 70.0 s = 160.0 TPS_average
block 199 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11208 / 71.0 s = 157.9 TPS_average
block 200 | new #TX 182 / 1000 ms = 182.0 TPS_current | total: #TX 11390 / 72.2 s = 157.8 TPS_average
block 201 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11390 / 73.1 s = 155.8 TPS_average
block 202 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11390 / 74.0 s = 153.9 TPS_average
block 203 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11390 / 74.9 s = 152.0 TPS_average
block 204 | new #TX 182 / 1000 ms = 182.0 TPS_current | total: #TX 11572 / 76.2 s = 151.9 TPS_average
block 205 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11572 / 77.1 s = 150.1 TPS_average
block 206 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11572 / 78.0 s = 148.4 TPS_average
block 207 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11572 / 78.9 s = 146.6 TPS_average
block 208 | new #TX 182 / 1000 ms = 182.0 TPS_current | total: #TX 11754 / 80.1 s = 146.7 TPS_average
block 209 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11754 / 81.1 s = 144.9 TPS_average
block 210 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11754 / 82.0 s = 143.3 TPS_average
block 211 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11754 / 83.0 s = 141.7 TPS_average
block 212 | new #TX 183 / 1000 ms = 183.0 TPS_current | total: #TX 11937 / 84.2 s = 141.7 TPS_average
block 213 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11937 / 85.2 s = 140.1 TPS_average
block 214 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11937 / 86.1 s = 138.6 TPS_average
block 215 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 11937 / 87.1 s = 137.1 TPS_average
block 216 | new #TX 183 / 1000 ms = 183.0 TPS_current | total: #TX 12120 / 88.1 s = 137.6 TPS_average
block 217 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 12120 / 89.0 s = 136.2 TPS_average
block 218 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 12120 / 89.9 s = 134.8 TPS_average
block 219 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 12120 / 91.2 s = 132.9 TPS_average
block 220 | new #TX 183 / 1000 ms = 183.0 TPS_current | total: #TX 12303 / 92.2 s = 133.5 TPS_average
block 221 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 12303 / 93.1 s = 132.1 TPS_average
block 222 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 12303 / 94.1 s = 130.8 TPS_average
block 223 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 12303 / 95.0 s = 129.5 TPS_average
block 224 | new #TX 183 / 1000 ms = 183.0 TPS_current | total: #TX 12486 / 96.3 s = 129.7 TPS_average
block 225 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 12486 / 96.9 s = 128.9 TPS_average
block 226 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 12486 / 98.1 s = 127.2 TPS_average
block 227 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 12486 / 99.1 s = 126.0 TPS_average
block 228 | new #TX 183 / 1000 ms = 183.0 TPS_current | total: #TX 12669 / 100.0 s = 126.7 TPS_average
block 229 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 12669 / 100.9 s = 125.5 TPS_average
block 230 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 12669 / 102.2 s = 124.0 TPS_average
block 231 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 12669 / 103.1 s = 122.8 TPS_average
block 232 | new #TX 184 / 1000 ms = 184.0 TPS_current | total: #TX 12853 / 104.1 s = 123.5 TPS_average
block 233 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 12853 / 105.1 s = 122.3 TPS_average
block 234 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 12853 / 106.0 s = 121.2 TPS_average
block 235 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 12853 / 107.0 s = 120.2 TPS_average
block 236 | new #TX 184 / 1000 ms = 184.0 TPS_current | total: #TX 13037 / 108.2 s = 120.5 TPS_average
block 237 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13037 / 109.2 s = 119.4 TPS_average
block 238 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13037 / 110.1 s = 118.4 TPS_average
block 239 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13037 / 111.0 s = 117.4 TPS_average
block 240 | new #TX 184 / 1000 ms = 184.0 TPS_current | total: #TX 13221 / 112.3 s = 117.7 TPS_average
block 241 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13221 / 112.9 s = 117.1 TPS_average
block 242 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13221 / 114.2 s = 115.8 TPS_average
block 243 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13221 / 115.1 s = 114.8 TPS_average
block 244 | new #TX 184 / 1000 ms = 184.0 TPS_current | total: #TX 13405 / 116.1 s = 115.5 TPS_average
block 245 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13405 / 117.0 s = 114.6 TPS_average
block 246 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13405 / 118.0 s = 113.6 TPS_average
block 247 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13405 / 118.9 s = 112.7 TPS_average
block 248 | new #TX 184 / 1000 ms = 184.0 TPS_current | total: #TX 13589 / 120.2 s = 113.1 TPS_average
block 249 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13589 / 121.1 s = 112.2 TPS_average
block 250 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13589 / 122.1 s = 111.3 TPS_average
block 251 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13589 / 123.0 s = 110.5 TPS_average
block 252 | new #TX 184 / 1000 ms = 184.0 TPS_current | total: #TX 13773 / 124.3 s = 110.8 TPS_average
block 253 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13773 / 124.9 s = 110.2 TPS_average
block 254 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13773 / 126.2 s = 109.2 TPS_average
block 255 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13773 / 127.1 s = 108.4 TPS_average
block 256 | new #TX 185 / 1000 ms = 185.0 TPS_current | total: #TX 13958 / 128.1 s = 109.0 TPS_average
block 257 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13958 / 129.0 s = 108.2 TPS_average
block 258 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13958 / 130.0 s = 107.4 TPS_average
block 259 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 13958 / 131.2 s = 106.4 TPS_average
block 260 | new #TX 185 / 1000 ms = 185.0 TPS_current | total: #TX 14143 / 132.2 s = 107.0 TPS_average
block 261 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 14143 / 133.1 s = 106.2 TPS_average
block 262 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 14143 / 134.1 s = 105.5 TPS_average
block 263 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 14143 / 135.0 s = 104.7 TPS_average
block 264 | new #TX 185 / 1000 ms = 185.0 TPS_current | total: #TX 14328 / 136.0 s = 105.4 TPS_average
block 265 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 14328 / 136.9 s = 104.6 TPS_average
block 266 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 14328 / 138.2 s = 103.7 TPS_average
block 267 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 14328 / 139.1 s = 103.0 TPS_average
block 268 | new #TX 185 / 1000 ms = 185.0 TPS_current | total: #TX 14513 / 140.1 s = 103.6 TPS_average
block 269 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 14513 / 141.0 s = 102.9 TPS_average
block 270 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 14513 / 142.0 s = 102.2 TPS_average
block 271 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 14513 / 142.9 s = 101.6 TPS_average
block 272 | new #TX 185 / 1000 ms = 185.0 TPS_current | total: #TX 14698 / 144.2 s = 102.0 TPS_average
block 273 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 14698 / 145.1 s = 101.3 TPS_average
block 274 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 14698 / 146.0 s = 100.6 TPS_average
block 275 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 14698 / 147.0 s = 100.0 TPS_average
block 276 | new #TX 186 / 1000 ms = 186.0 TPS_current | total: #TX 14884 / 148.3 s = 100.4 TPS_average
block 277 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 14884 / 148.9 s =  99.9 TPS_average
block 278 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 14884 / 150.2 s =  99.1 TPS_average
block 279 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 14884 / 151.1 s =  98.5 TPS_average
block 280 | new #TX 186 / 1000 ms = 186.0 TPS_current | total: #TX 15070 / 152.1 s =  99.1 TPS_average
block 281 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 15070 / 153.0 s =  98.5 TPS_average
block 282 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 15070 / 154.0 s =  97.9 TPS_average
block 283 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 15070 / 154.9 s =  97.3 TPS_average
block 284 | new #TX 186 / 1000 ms = 186.0 TPS_current | total: #TX 15256 / 156.2 s =  97.7 TPS_average
block 285 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 15256 / 157.1 s =  97.1 TPS_average
block 286 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 15256 / 158.1 s =  96.5 TPS_average
block 287 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 15256 / 159.0 s =  95.9 TPS_average
block 288 | new #TX 186 / 1000 ms = 186.0 TPS_current | total: #TX 15442 / 160.0 s =  96.5 TPS_average
block 289 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 15442 / 160.9 s =  96.0 TPS_average
block 290 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 15442 / 162.2 s =  95.2 TPS_average
block 291 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 15442 / 163.1 s =  94.7 TPS_average
block 292 | new #TX 186 / 1000 ms = 186.0 TPS_current | total: #TX 15628 / 164.1 s =  95.2 TPS_average
block 293 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 15628 / 165.0 s =  94.7 TPS_average
block 294 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 15628 / 166.0 s =  94.2 TPS_average
block 295 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 15628 / 166.9 s =  93.6 TPS_average
block 296 | new #TX 186 / 1000 ms = 186.0 TPS_current | total: #TX 15814 / 168.2 s =  94.0 TPS_average
block 297 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 15814 / 169.1 s =  93.5 TPS_average
block 298 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 15814 / 170.1 s =  93.0 TPS_average
block 299 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 15814 / 171.0 s =  92.5 TPS_average
block 300 | new #TX 187 / 1000 ms = 187.0 TPS_current | total: #TX 16001 / 172.0 s =  93.1 TPS_average
block 301 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16001 / 172.9 s =  92.6 TPS_average
block 302 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16001 / 174.1 s =  91.9 TPS_average
block 303 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16001 / 175.1 s =  91.4 TPS_average
block 304 | new #TX 187 / 1000 ms = 187.0 TPS_current | total: #TX 16188 / 176.0 s =  92.0 TPS_average
block 305 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16188 / 176.9 s =  91.5 TPS_average
block 306 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16188 / 177.9 s =  91.0 TPS_average
block 307 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16188 / 179.1 s =  90.4 TPS_average
block 308 | new #TX 187 / 1000 ms = 187.0 TPS_current | total: #TX 16375 / 180.1 s =  90.9 TPS_average
block 309 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16375 / 181.0 s =  90.4 TPS_average
block 310 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16375 / 182.0 s =  90.0 TPS_average
block 311 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16375 / 182.9 s =  89.5 TPS_average
block 312 | new #TX 187 / 1000 ms = 187.0 TPS_current | total: #TX 16562 / 184.2 s =  89.9 TPS_average
block 313 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16562 / 185.2 s =  89.4 TPS_average
block 314 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16562 / 186.1 s =  89.0 TPS_average
block 315 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16562 / 187.1 s =  88.5 TPS_average
block 316 | new #TX 187 / 1000 ms = 187.0 TPS_current | total: #TX 16749 / 188.0 s =  89.1 TPS_average
block 317 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16749 / 188.9 s =  88.7 TPS_average
block 318 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16749 / 190.2 s =  88.1 TPS_average
block 319 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16749 / 191.1 s =  87.6 TPS_average
block 320 | new #TX 188 / 1000 ms = 188.0 TPS_current | total: #TX 16937 / 192.1 s =  88.2 TPS_average
block 321 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16937 / 193.0 s =  87.7 TPS_average
block 322 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16937 / 193.9 s =  87.3 TPS_average
block 323 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 16937 / 194.9 s =  86.9 TPS_average
block 324 | new #TX 188 / 1000 ms = 188.0 TPS_current | total: #TX 17125 / 196.2 s =  87.3 TPS_average
block 325 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 17125 / 197.1 s =  86.9 TPS_average
block 326 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 17125 / 198.1 s =  86.5 TPS_average
block 327 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 17125 / 199.0 s =  86.1 TPS_average
block 328 | new #TX 188 / 1000 ms = 188.0 TPS_current | total: #TX 17313 / 200.3 s =  86.4 TPS_average
block 329 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 17313 / 200.9 s =  86.2 TPS_average
block 330 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 17313 / 202.2 s =  85.6 TPS_average
block 331 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 17313 / 203.1 s =  85.2 TPS_average
block 332 | new #TX 188 / 1000 ms = 188.0 TPS_current | total: #TX 17501 / 204.1 s =  85.7 TPS_average
block 333 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 17501 / 205.1 s =  85.3 TPS_average
block 334 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 17501 / 206.0 s =  85.0 TPS_average
block 335 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 17501 / 206.9 s =  84.6 TPS_average
block 336 | new #TX 188 / 1000 ms = 188.0 TPS_current | total: #TX 17689 / 208.2 s =  85.0 TPS_average
block 337 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 17689 / 209.2 s =  84.6 TPS_average
block 338 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 17689 / 210.1 s =  84.2 TPS_average
block 339 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 17689 / 211.1 s =  83.8 TPS_average
block 340 | new #TX 188 / 1000 ms = 188.0 TPS_current | total: #TX 17877 / 212.3 s =  84.2 TPS_average
block 341 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 17877 / 213.0 s =  83.9 TPS_average
block 342 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 17877 / 213.9 s =  83.6 TPS_average
block 343 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 17877 / 215.1 s =  83.1 TPS_average
block 344 | new #TX 189 / 1000 ms = 189.0 TPS_current | total: #TX 18066 / 216.1 s =  83.6 TPS_average
block 345 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 18066 / 217.0 s =  83.2 TPS_average
block 346 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 18066 / 218.0 s =  82.9 TPS_average
block 347 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 18066 / 218.9 s =  82.5 TPS_average
block 348 | new #TX 189 / 1000 ms = 189.0 TPS_current | total: #TX 18255 / 220.2 s =  82.9 TPS_average
block 349 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 18255 / 221.2 s =  82.5 TPS_average
block 350 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 18255 / 222.1 s =  82.2 TPS_average
block 351 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 18255 / 223.1 s =  81.8 TPS_average
block 352 | new #TX 189 / 1000 ms = 189.0 TPS_current | total: #TX 18444 / 224.0 s =  82.3 TPS_average
block 353 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 18444 / 224.9 s =  82.0 TPS_average
block 354 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 18444 / 226.2 s =  81.5 TPS_average
block 355 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 18444 / 227.1 s =  81.2 TPS_average
block 356 | new #TX 189 / 1000 ms = 189.0 TPS_current | total: #TX 18633 / 228.1 s =  81.7 TPS_average
block 357 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 18633 / 229.1 s =  81.3 TPS_average
block 358 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 18633 / 230.0 s =  81.0 TPS_average
block 359 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 18633 / 230.9 s =  80.7 TPS_average
block 360 | new #TX 189 / 1000 ms = 189.0 TPS_current | total: #TX 18822 / 232.2 s =  81.1 TPS_average
block 361 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 18822 / 233.2 s =  80.7 TPS_average
block 362 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 18822 / 234.1 s =  80.4 TPS_average
block 363 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 18822 / 235.1 s =  80.1 TPS_average
block 364 | new #TX 190 / 1000 ms = 190.0 TPS_current | total: #TX 19012 / 236.3 s =  80.4 TPS_average
block 365 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19012 / 237.0 s =  80.2 TPS_average
block 366 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19012 / 237.9 s =  79.9 TPS_average
block 367 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19012 / 239.1 s =  79.5 TPS_average
block 368 | new #TX 190 / 1000 ms = 190.0 TPS_current | total: #TX 19202 / 240.1 s =  80.0 TPS_average
block 369 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19202 / 241.1 s =  79.7 TPS_average
block 370 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19202 / 242.0 s =  79.4 TPS_average
block 371 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19202 / 242.9 s =  79.0 TPS_average
block 372 | new #TX 190 / 1000 ms = 190.0 TPS_current | total: #TX 19392 / 244.2 s =  79.4 TPS_average
block 373 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19392 / 245.2 s =  79.1 TPS_average
block 374 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19392 / 246.1 s =  78.8 TPS_average
block 375 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19392 / 247.0 s =  78.5 TPS_average
block 376 | new #TX 190 / 1000 ms = 190.0 TPS_current | total: #TX 19582 / 248.0 s =  79.0 TPS_average
block 377 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19582 / 248.9 s =  78.7 TPS_average
block 378 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19582 / 250.2 s =  78.3 TPS_average
block 379 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19582 / 251.1 s =  78.0 TPS_average
block 380 | new #TX 190 / 1000 ms = 190.0 TPS_current | total: #TX 19772 / 252.0 s =  78.4 TPS_average
block 381 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19772 / 253.0 s =  78.1 TPS_average
block 382 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19772 / 253.9 s =  77.9 TPS_average
block 383 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19772 / 255.2 s =  77.5 TPS_average
block 384 | new #TX 191 / 1000 ms = 191.0 TPS_current | total: #TX 19963 / 256.2 s =  77.9 TPS_average
block 385 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19963 / 257.1 s =  77.6 TPS_average
block 386 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19963 / 258.1 s =  77.4 TPS_average
block 387 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 19963 / 259.0 s =  77.1 TPS_average
block 388 | new #TX  38 / 1000 ms =  38.0 TPS_current | total: #TX 20001 / 259.9 s =  76.9 TPS_average
block 389 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 261.2 s =  76.6 TPS_average
block 390 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 262.1 s =  76.3 TPS_average
block 391 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 263.1 s =  76.0 TPS_average
block 392 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 264.0 s =  75.8 TPS_average
block 393 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 265.0 s =  75.5 TPS_average
block 394 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 265.9 s =  75.2 TPS_average
block 395 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 267.1 s =  74.9 TPS_average
block 396 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 268.1 s =  74.6 TPS_average
block 397 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 269.0 s =  74.3 TPS_average
block 398 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 270.0 s =  74.1 TPS_average
block 399 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 270.9 s =  73.8 TPS_average
block 400 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 272.2 s =  73.5 TPS_average
block 401 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 273.1 s =  73.2 TPS_average
block 402 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 274.1 s =  73.0 TPS_average
block 403 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 275.0 s =  72.7 TPS_average
block 404 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 276.0 s =  72.5 TPS_average
block 405 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 276.9 s =  72.2 TPS_average
block 406 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 278.2 s =  71.9 TPS_average
block 407 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 279.1 s =  71.7 TPS_average
block 408 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 280.0 s =  71.4 TPS_average
block 409 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 281.0 s =  71.2 TPS_average
block 410 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 281.9 s =  70.9 TPS_average
block 411 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 283.2 s =  70.6 TPS_average
block 412 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 284.1 s =  70.4 TPS_average
block 413 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 285.0 s =  70.2 TPS_average
block 414 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 286.0 s =  69.9 TPS_average
block 415 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 286.9 s =  69.7 TPS_average
block 416 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 287.9 s =  69.5 TPS_average
block 417 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 289.1 s =  69.2 TPS_average
block 418 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 290.1 s =  69.0 TPS_average
block 419 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 291.0 s =  68.7 TPS_average
block 420 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 291.9 s =  68.5 TPS_average
block 421 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 292.9 s =  68.3 TPS_average
block 422 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 294.1 s =  68.0 TPS_average
block 423 | new #TX   0 / 1000 ms =   0.0 TPS_current | total: #TX 20001 / 295.0 s =  67.8 TPS_average

all 20k transactions are arriving, but at peak 175 TPS (because of gasLimit), and much slower in the end (because of too small mempool).

Please help, thanks.

Puneetha17 commented 6 years ago

Thanks for your feedback. After making the changes to istanbul-genesis.json#L17 and in istanbul-start.sh#L11, you will have to rebuild the the image.

Currently, we are downloading the image from the registry, you can change Docker compose file following this line. It will build the image all over with your changes.

You can then build and run the image with docker-compose -f docker/quorum-crux/docker-compose.yaml up --build

drandreaskrueger commented 6 years ago

perfect, and thanks a lot for getting back to me so quickly!

what about adding a rebuild-docker.sh or run-local-docker-compose.sh into that repo?

My changes are here: https://github.com/drandreaskrueger/crux/commit/74e468791eb2df570d8cbd370e198b2ed338bdff

drandreaskrueger commented 6 years ago

Actually, it does not look as if it has rebuild anything:

git clone git@github.com:drandreaskrueger/crux.git drandreaskrueger_crux

cd drandreaskrueger_crux/docker/quorum-crux
docker-compose -f docker-compose.yaml up --build

Starting quorum4 ... done
Starting quorum2 ... done
Starting quorum1 ... done
Starting quorum3 ... done
Attaching to quorum1, quorum3, quorum2, quorum4
quorum1  | [*] Cleaning up temporary data directories
quorum1  | [*] Configuring node
...
Puneetha17 commented 6 years ago

Has this line been commented and the 3 lines following this been uncommented?

drandreaskrueger commented 6 years ago

ah sorry, had not see that comment/uncomment comment. Sorry.

Now done like this:

version: "3.4"
services:

  node1: &quorum_crux_node
    # Pull image down from Docker Hub
    #    image: blkio10/quorum-crux:v1.0.0
    # Uncomment the below, and comment out the above line to build the Docker images yourself
    image: blk.io/quorum/quorum-crux
#    build:
#      context: .
    container_name: quorum1
    ports:

correct?

drandreaskrueger commented 6 years ago

results in:

docker-compose -f docker-compose.yaml up --build
Pulling node1 (blk.io/quorum/quorum-crux:)...
ERROR: error parsing HTTP 404 response body: invalid character '<' looking for beginning of value: "<!DOCTYPE html>\n<html>\n  <head>\n    <meta http-equiv=\"Content-type\" content=\"text/html; charset=utf-8\">\n    <meta http-equiv=\"Content-Security-Policy\" content=\"default-src 'none'; style-src 'unsafe-inline'; img-src data:; connect-src 'self'\">\n    <title>Page not found &middot; GitHub Pages</title>\n    <style type=\"text/css\" media=\"screen\">\n      body {\n        background-color: #f1f1f1;\n        margin: 0;\n        font-family: \"Helvetica Neue\", Helvetica, Arial, sans-serif;\n      }\n\n      .container { margin: 50px auto 40px auto; width: 600px; text-align: center; }\n\n      a { color: #4183c4; text-decoration: none; }\n      a:hover { text-decoration: underline; }\n\n      h1 { width: 800px; position:relative; left: -100px; letter-spacing: -1px; line-height: 60px; font-size: 60px; font-weight: 100; margin: 0px 0 50px 0; text-shadow: 0 1px 0 #fff; }\n      p { color: rgba(0, 0, 0, 0.5); margin: 20px 0; line-height: 1.6; }\n\n      ul { list-style: none; margin: 25px 0; padding: 0; }\n      li { display: table-cell; font-weight: bold; width: 1%; }\n\n      .logo { display: inline-block; margin-top: 35px; }\n      .logo-img-2x { display: none; }\n      @media\n      only screen and (-webkit-min-device-pixel-ratio: 2),\n      only screen and (   min--moz-device-pixel-ratio: 2),\n      only screen and (     -o-min-device-pixel-ratio: 2/1),\n      only screen and (        min-device-pixel-ratio: 2),\n      only screen and (                min-resolution: 192dpi),\n      only screen and (                min-resolution: 2dppx) {\n        .logo-img-1x { display: none; }\n        .logo-img-2x { display: inline-block; }\n      }\n\n      #suggestions {\n        margin-top: 35px;\n        color: #ccc;\n      }\n      #suggestions a {\n        color: #666666;\n        font-weight: 200;\n        font-size: 14px;\n        margin: 0 10px;\n      }\n\n    </style>\n  </head>\n  <body>\n\n    <div class=\"container\">\n\n      <h1>404</h1>\n      <p><strong>File not found</strong></p>\n\n      <p>\n        The site configured at this address does not\n        contain the requested file.\n      </p>\n\n      <p>\n        If this is your site, make sure that the filename case matches the URL.<br>\n        For root URLs (like <code>http://example.com/</code>) you must provide an\n        <code>index.html</code> file.\n      </p>\n\n      <p>\n        <a href=\"https://help.github.com/pages/\">Read the full documentation</a>\n        for more information about using <strong>GitHub Pages</strong>.\n      </p>\n\n      <div id=\"suggestions\">\n        <a href=\"https://status.github.com\">GitHub Status</a> &mdash;\n        <a href=\"https://twitter.com/githubstatus\">@githubstatus</a>\n      </div>\n\n      <a href=\"/\" class=\"logo logo-img-1x\">\n        <img width=\"32\" height=\"32\" title=\"\" alt=\"\" src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAACAAAAAgCAYAAABzenr0AAAAGXRFWHRTb2Z0d2FyZQBBZG9iZSBJbWFnZVJlYWR5ccllPAAAAyRpVFh0WE1MOmNvbS5hZG9iZS54bXAAAAAAADw/eHBhY2tldCBiZWdpbj0i77u/IiBpZD0iVzVNME1wQ2VoaUh6cmVTek5UY3prYzlkIj8+IDx4OnhtcG1ldGEgeG1sbnM6eD0iYWRvYmU6bnM6bWV0YS8iIHg6eG1wdGs9IkFkb2JlIFhNUCBDb3JlIDUuMy1jMDExIDY2LjE0NTY2MSwgMjAxMi8wMi8wNi0xNDo1NjoyNyAgICAgICAgIj4gPHJkZjpSREYgeG1sbnM6cmRmPSJodHRwOi8vd3d3LnczLm9yZy8xOTk5LzAyLzIyLXJkZi1zeW50YXgtbnMjIj4gPHJkZjpEZXNjcmlwdGlvbiByZGY6YWJvdXQ9IiIgeG1sbnM6eG1wPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bWxuczp4bXBNTT0iaHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL21tLyIgeG1sbnM6c3RSZWY9Imh0dHA6Ly9ucy5hZG9iZS5jb20veGFwLzEuMC9zVHlwZS9SZXNvdXJjZVJlZiMiIHhtcDpDcmVhdG9yVG9vbD0iQWRvYmUgUGhvdG9zaG9wIENTNiAoTWFjaW50b3NoKSIgeG1wTU06SW5zdGFuY2VJRD0ieG1wLmlpZDpFMTZCRDY3REIzRjAxMUUyQUQzREIxQzRENUFFNUM5NiIgeG1wTU06RG9jdW1lbnRJRD0ieG1wLmRpZDpFMTZCRDY3RUIzRjAxMUUyQUQzREIxQzRENUFFNUM5NiI+IDx4bXBNTTpEZXJpdmVkRnJvbSBzdFJlZjppbnN0YW5jZUlEPSJ4bXAuaWlkOkUxNkJENjdCQjNGMDExRTJBRDNEQjFDNEQ1QUU1Qzk2IiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOkUxNkJENjdDQjNGMDExRTJBRDNEQjFDNEQ1QUU1Qzk2Ii8+IDwvcmRmOkRlc2NyaXB0aW9uPiA8L3JkZjpSREY+IDwveDp4bXBtZXRhPiA8P3hwYWNrZXQgZW5kPSJyIj8+SM9MCAAAA+5JREFUeNrEV11Ik1EY3s4+ddOp29Q5b0opCgKFsoKoi5Kg6CIhuwi6zLJLoYLopq4qsKKgi4i6CYIoU/q5iDAKs6syoS76IRWtyJ+p7cdt7sf1PGOD+e0c3dygAx/67ZzzPM95/877GYdHRg3ZjMXFxepQKNS6sLCwJxqNNuFpiMfjVs4ZjUa/pmmjeD6VlJS8NpvNT4QQ7mxwjSsJiEQim/1+/9lgMHgIr5ohuxG1WCw9Vqv1clFR0dCqBODElV6v90ogEDjGdYbVjXhpaendioqK07CIR7ZAqE49PT09BPL2PMgTByQGsYiZlQD4uMXtdr+JxWINhgINYhGT2MsKgMrm2dnZXgRXhaHAg5jEJodUAHxux4LudHJE9RdEdA+i3Juz7bGHe4mhE9FNrgwBCLirMFV9Okh5eflFh8PR5nK5nDabrR2BNJlKO0T35+Li4n4+/J+/JQCxhmu5h3uJoXNHPbmWZAHMshWB8l5/ipqammaAf0zPDDx1ONV3vurdidqwAQL+pEc8sLcAe1CCvQ3YHxIW8Pl85xSWNC1hADDIv0rIE/o4J0k3kww4xSlwIhcq3EFFOm7KN/hUGOQkt0CFa5WpNJlMvxBEz/IVQAxg/ZRZl9wiHA63yDYieM7DnLP5CiAGsC7I5sgtYKJGWe2A8seFqgFJrJjEPY1Cn3pJ8/9W1e5VWsFDTEmFrBcoDhZJEQkXuhICMyKpjhahqN21hRYATKfUOlDmkygrR4o4C0VOLGJKrOITKB4jijzdXygBKixyC5TDQdnk/Pz8qRw6oOWGlsTKGOQW6OH6FBWsyePxdOXLTgxiyebILZCjz+GLgMIKnXNzc49YMlcRdHXcSwxFVgTInQhC9G33UhNoJLuqq6t345p9y3eUy8OTk5PjAHuI9uo4b07FBaOhsu0A4Unc+T1TU1Nj3KsSSE5yJ65jqF2DDd8QqWYmAZrIM2VlZTdnZmb6AbpdV9V6ec9znf5Q7HjYumdRE0JOp3MjitO4SFa+cZz8Umqe3TCbSLvdfkR/kWDdNQl5InuTcysOcpFT35ZrbBxx4p3JAHlZVVW1D/634VRt+FvLBgK/v5LV9WS+10xMTEwtRw7XvqOL+e2Q8V3AYIOIAXQ26/heWVnZCVfcyKHg2CBgTpmPmjYM8l24GyaUHyaIh7XwfR9ErE8qHoDfn2LTNAVC0HX6MFcBIP8Bi+6F6cdW/DICkANRfx99fEYFQ7Nph5i/uQiA214gno7K+guhaiKg9gC62+M8eR7XsBsYJ4ilam60Fb7r7uAj8wFyuwM1oIOWgfmDy6RXEEQzJMPe23DXrVS7rtyD3Df8z/FPgAEAzWU5Ku59ZAUAAAAASUVORK5CYII=\">\n      </a>\n\n      <a href=\"/\" class=\"logo logo-img-2x\">\n        <img width=\"32\" height=\"32\" title=\"\" alt=\"\" src=\"data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAEAAAABACAYAAACqaXHeAAAAGXRFWHRTb2Z0d2FyZQBBZG9iZSBJbWFnZVJlYWR5ccllPAAAAyRpVFh0WE1MOmNvbS5hZG9iZS54bXAAAAAAADw/eHBhY2tldCBiZWdpbj0i77u/IiBpZD0iVzVNME1wQ2VoaUh6cmVTek5UY3prYzlkIj8+IDx4OnhtcG1ldGEgeG1sbnM6eD0iYWRvYmU6bnM6bWV0YS8iIHg6eG1wdGs9IkFkb2JlIFhNUCBDb3JlIDUuMy1jMDExIDY2LjE0NTY2MSwgMjAxMi8wMi8wNi0xNDo1NjoyNyAgICAgICAgIj4gPHJkZjpSREYgeG1sbnM6cmRmPSJodHRwOi8vd3d3LnczLm9yZy8xOTk5LzAyLzIyLXJkZi1zeW50YXgtbnMjIj4gPHJkZjpEZXNjcmlwdGlvbiByZGY6YWJvdXQ9IiIgeG1sbnM6eG1wPSJodHRwOi8vbnMuYWRvYmUuY29tL3hhcC8xLjAvIiB4bWxuczp4bXBNTT0iaHR0cDovL25zLmFkb2JlLmNvbS94YXAvMS4wL21tLyIgeG1sbnM6c3RSZWY9Imh0dHA6Ly9ucy5hZG9iZS5jb20veGFwLzEuMC9zVHlwZS9SZXNvdXJjZVJlZiMiIHhtcDpDcmVhdG9yVG9vbD0iQWRvYmUgUGhvdG9zaG9wIENTNiAoTWFjaW50b3NoKSIgeG1wTU06SW5zdGFuY2VJRD0ieG1wLmlpZDpEQUM1QkUxRUI0MUMxMUUyQUQzREIxQzRENUFFNUM5NiIgeG1wTU06RG9jdW1lbnRJRD0ieG1wLmRpZDpEQUM1QkUxRkI0MUMxMUUyQUQzREIxQzRENUFFNUM5NiI+IDx4bXBNTTpEZXJpdmVkRnJvbSBzdFJlZjppbnN0YW5jZUlEPSJ4bXAuaWlkOkUxNkJENjdGQjNGMDExRTJBRDNEQjFDNEQ1QUU1Qzk2IiBzdFJlZjpkb2N1bWVudElEPSJ4bXAuZGlkOkUxNkJENjgwQjNGMDExRTJBRDNEQjFDNEQ1QUU1Qzk2Ii8+IDwvcmRmOkRlc2NyaXB0aW9uPiA8L3JkZjpSREY+IDwveDp4bXBtZXRhPiA8P3hwYWNrZXQgZW5kPSJyIj8+hfPRaQAAB6lJREFUeNrsW2mME2UYbodtt+2222u35QheoCCYGBQligIJgkZJNPzgigoaTEj8AdFEMfADfyABkgWiiWcieK4S+QOiHAYUj2hMNKgYlEujpNttu9vttbvdw+chU1K6M535pt3ubHCSyezR+b73eb73+t7vrfXsufOW4bz6+vom9/b23ovnNNw34b5xYGAgODg46Mbt4mesVmsWd1qSpHhdXd2fuP/Afcput5/A88xwymcdBgLqenp6FuRyuWV4zu/v759QyWBjxoz5t76+/gun09mK5xFyakoCAPSaTCazNpvNPoYVbh6O1YKGRF0u13sNDQ27QMzfpiAAKj0lnU6/gBVfAZW2WWpwwVzy0IgP3G73FpjI6REhAGA9qVRqA1b9mVoBVyIC2tDi8Xg24+dUzQiAbS/s7Ox8G2o/3mKCC+Zw0efzPQEfcVjYrARX3dbV1bUtHo8fMgt42f+Mp0yUTVQbdWsAHVsikdiHkHaPxcQXQufXgUBgMRxme9U0AAxfH4vFvjM7eF6UkbJS5qoQwEQGA57Ac5JllFyUVZZ5ckUEgMVxsK2jlSYzI+QXJsiyjzNEAJyJAzb/KQa41jJKL8pODMQiTEAymXw5n8/P0IjD3bh7Rgog59aanxiIRTVvV/oj0tnHca/WMrVwODwB3raTGxzkBg/gnZVapFV62Wy2n5AO70HM/5wbJ0QnXyQSaVPDIuNZzY0V3ntHMwxiwHA0Gj2Np7ecIBDgaDAYXKCQJM1DhrgJ3nhulcPbl8j4NmHe46X/g60fwbz3aewjkqFQaAqebWU1AOqyQwt8Id6qEHMc97zu7u7FGGsn7HAiVuosVw7P35C1nccdgSCxop1dHeZswmfHMnxBo6ZTk+jN8dl/vF7vWofDsa+MLN9oEUBMxOb3+1eoEsBVw6Zmua49r8YmhAKDiEPcMwBsxMiqQ+ixzPFxZyqRpXARG/YOr1ObFJ0gUskXBbamcR1OKmMUvDxHRAu8/LmY3jFLMUpFqz9HxG65smYJdyKyECOxDiEAe/p1gjF2oonivZAsxVgl2daa4EQWCW6J55qFAFFZiJWYLxNQy2qOSUzGRsyXCUDIeliwAHEO4WSlWQBRFoZakXcKmCXmyXAKs0Ve9vl8q42WoIYpJU4hV3hKcNs8m9gl7p/xQ73eF5kB4j5mNrWmTJRNwAzqiV1CxjVTZCIkEq+Z1bZFZSN2CenmVAFVy4Plz8xKAGWjjAKFk6lCBMDR/MJjLLMSQNm43xAiQKTaA+9/wewhDjL+JVI1kkTSSOTcKbMTwPqESAot6dn6Fr1gHwVJju6IRuyiByPuUUBAg5DGkAgBmxlvdgIEK9gDkohdY/BJo4CAG0R8miRSsGABkgVQs4KXu098IgUXSSRsFAoKZiVAVDY2WUiiPTjYRi41KwGisrGsLtlsth8Fiwnz2fBkQvWfRtlE3iF2yW63/yCacXZ1dW02GwGyTFaRd4idJnCKHRaCxYRHoG5LTKT6SyiToP1fJHbmAYPYRR0UnZQtMnA6s0zg+GZBlt0Gdo7EPHgpE3Q6nZ8YyLhc8Xj8MJh/aKTAY+5FPAKHLE7RdwuYJZmNwzyCMkBCYyKROJBMJl9B/PXXCjjmCmDOVzH3fiPpObEWGqoKe4EBl8v1hlqsdLvd23mkxHM9pc9kMpmno9HoeTii7ewbHEZPPx1ztLS1tV3AnGuMjiNjvbQFuHw6zDo5By7dTPAQNBgMLrRarTkSls1mnwT7uwp9virx9QzbW/HuV/j5d/b+6jniKlllP8lkeONJDk+dq9GsQTnC4fB1heO0K47Hwe7WdDr9nAKgXwOBwHI+C45Htj1d6sd429TUNEcmUdc+PRaLHcvn87dXW4ugzdsaGxufL94NFv9zi1J7GVbhlvb2dnaJ3SVrxfc+n2+NTsZ7/H7/Mr3g5XdSIHyJSH1PZ+7fToyl2+ErqilgZ4NaLYB9goVGaHjR93Hv1ZrU4XDsFT20kH3PObzbWk0CgG1jacVIUnAQb9F+VexyLMzkpcLv0IJV7AHQIOCAUYHx7v5qgScmYHtTqSAyZLEJTK22Bie4iq3xsqpm4SAf9Hq9a2DnJ4uLK3SEULcdRvp3i3zHySqpficxEdsQc1NrlYXXvR+O7qASSezXB+h1SuUomgg9LL8BUoV4749EIolKh+EiqWmqVEZlDgHks2pxHw7xTqUQw9J5NcAXOK10AGIoZ6Zli6JY6Z1Q461KoZ4NiKLHarW+KDsxlDUPHZ5zPQZqUVDPJsTqb5n9malbpAh8C2XXDLl62+WZIDFRUlNVOiwencnNU3aQEkL+cDMSoLvZo2fQB7AJssNAuFuvorlDVVkkg2I87+jo2K2QAVphDrfyViK5VqtO34OkaxXCp+7drdDBCAdubm6eidX+2WwqT5komwh4YQLk+H4aE93h8Xg2gvHekQZOGSgLZTLyDTLJ4Lx9/KZWKBSainT4Iy3FqQBfnUZR42PKQFksBr9QKVXCPusD3OiA/RkQ5kP8qV/Jl1WywAp/6+dcmPM2zL1UrUahe4JqfnWWKXIul3uUbfP8njAFLW1OFr3gdFtZ72cNH+PtQT7/brW+NXqJAHh0y9V8/U/A1U7AfwIMAD7mS3pCbuWJAAAAAElFTkSuQmCC\">\n      </a>\n    </div>\n  </body>\n</html>\n"
Puneetha17 commented 6 years ago

You will have to uncomment this and the next line.

Thanks for suggesting a rebuild-docker.sh. We could work on it, if it makes it simpler.

Docker compose file should look like 

 node1: &quorum_crux_node
    # Pull image down from Docker Hub
# image: blkio10/quorum-crux:v1.0.0
    # Uncomment the below, and comment out the above line to build the Docker images yourself
    image: blk.io/quorum/quorum-crux
    build:
      context: .
    container_name: quorum1
    ports:
drandreaskrueger commented 6 years ago

thanks a lot, that seem to have worked:

docker-compose -f docker-compose.yaml up --build

Building node1
Step 1/24 : FROM alpine:3.8
...
# github.com/ethereum/go-ethereum/vendor/github.com/karalabe/hid
In file included from vendor/github.com/karalabe/hid/hid_enabled.go:22:0:
/usr/include/sys/poll.h:1:2: warning: #warning redirecting incorrect #include <sys/poll.h> to <poll.h> [-Wcpp]
 #warning redirecting incorrect #include <sys/poll.h> to <poll.h>
  ^~~~~~~
github.com/ethereum/go-ethereum/accounts/usbwallet
...
github.com/ethereum/go-ethereum/contracts/ens/contract
# github.com/ethereum/go-ethereum/cmd/rlpdump
loadinternal: cannot find runtime/cgo
github.com/ethereum/go-ethereum/contracts/chequebook/contract
...
go get -u golang.org/x/tools/cmd/goimports
# golang.org/x/tools/cmd/goimports
loadinternal: cannot find runtime/cgo
go get -u github.com/wadey/gocovmerge
# github.com/wadey/gocovmerge
loadinternal: cannot find runtime/cgo
(cd /quorum/crux/.GOPATH/src/github.com/blk-io/crux && ./bin/dep ensure)
# github.com/blk-io/crux/vendor/github.com/jsimonetti/berkeleydb
bdb.c: In function 'go_db_cursor':
bdb.c:78:38: warning: passing argument 3 of 'dbp->cursor' from incompatible pointer type [-Wincompatible-pointer-types]
         ret = dbp->cursor(dbp, NULL, dbcp, 0);
                                      ^~~~
bdb.c:78:38: note: expected 'DBC ** {aka struct __dbc **}' but argument is of type 'DBC * {aka struct __dbc *}'
fetch http://dl-cdn.alpinelinux.org/alpine/v3.8/main/x86_64/APKINDEX.tar.gz
fetch http://dl-cdn.alpinelinux.org/alpine/v3.8/community/x86_64/APKINDEX.tar.gz
World updated, but the following packages are not removed due to:
  gcc: go

(1/51) Purging boost-dev (1.66.0-r0)
...
Successfully tagged blk.io/quorum/quorum-crux:latest
Recreating quorum4 ... done
Recreating quorum1 ... done
Recreating quorum3 ... done
Recreating quorum2 ... done
Attaching to quorum1, quorum4, quorum3, quorum2
...
quorum2  | [*] Starting Ethereum nodes
quorum2  | ARGS="--txpool.globalslots 20000 --txpool.globalqueue 20000 --istanbul.blockperiod 1 --syncmode full --mine --rpc --rpcaddr 0.0.0.0 --rpcapi admin,db,eth,debug,miner,net,shh,txpool,personal,web3,quorum,istanbul "
quorum2  | PRIVATE_CONFIG=qdata/c/tm.ipc nohup geth --datadir qdata/dd $ARGS --rpcport $GETH_RPC_PORT --port $GETH_PORT --nodekeyhex $NODE_KEY --unlock 0 --password passwords.txt --verbosity=6 2>>qdata/logs/node.log &
quorum2  | set +v

I suppose the warnings and 'loadinternal: cannot find...' I can simply ignore?

Puneetha17 commented 6 years ago

Yea those warnings can be ignored.

drandreaskrueger commented 6 years ago

thanks.

Thanks for suggesting a rebuild-docker.sh. We could work on it, if it makes it simpler.

New suggestion: With https://github.com/drandreaskrueger/crux/blob/master/docker/quorum-crux/docker-compose-local.yaml -->

docker-compose -f docker-compose-local.yaml up --build

however, that docker-compose-local.yaml is a full copy of docker-compose.yaml with those 4 small changes only; redundancy <-- would be better if one docker-compose_....yaml imported another one; not sure whether that's possible.

drandreaskrueger commented 6 years ago

benchmarked:

https://gitlab.com/electronDLT/chainhammer/raw/master/chainreader/img/istanbul-crux-docker-1s-gas20mio_tps-bt-bs-gas_blks26-111.png

click here for more details: https://gitlab.com/electronDLT/chainhammer/blob/master/quorum-IBFT.md#crux-docker-4nodes

open question: is the higher speed (270 TPS instead of 200 TPS) because of docker, or because 4 not 7 nodes?

--> is there perhaps a simple way to start your 7nodes crux quorum-example but with only 4 nodes, so that I could see the difference with only 1 aspect changed?

(edit: shall I rather make this into a new issue? )

Puneetha17 commented 6 years ago

You could make changes to 3 files -

These are the changes I could think of on top of my mind. This should work, but I am not completely sure as we have not changed the genesis file.

You could test it, else we could check what more changes would be necessary.

drandreaskrueger commented 6 years ago

oh fantastic, thanks. Can try that next week.

what more changes would be necessary.

perhaps this needs edits too, no?

https://github.com/blk-io/quorum-examples/blob/master/examples/7nodes/permissioned-nodes.json

where are the authorities defined? the remaining 3 nodes should not be waiting for 6 nodes but now only for 3 other nodes, right?

Puneetha17 commented 6 years ago

Ah sorry, yes even the last 3 lines of https://github.com/blk-io/quorum-examples/blob/master/examples/7nodes/permissioned-nodes.json should be removed!

drandreaskrueger commented 6 years ago

Great, thanks.

I followed each step, but so far could not get it working.

See attachment: blk-io_quorum-examplesBRANCH-4nodes.zip

drandreaskrueger commented 6 years ago

Explanation why attachment:

I could not fork blk-io/quorum-examples because I have already forked jpmorganchase/quorum-examples (into here and made changes), and github allows only 1 fork.

So instead I cloned your blk-io/quorum-examples and branched into a new 4nodes branch, and zipped the result. <-- Please consider to include & upload my 4nodes branch into your blk-io/quorum-examples as a new branch. For that, the attachment contains all files, have a look at git checkout 4nodes; git log to see what I had changed.

(And of course - long term please have jpmorganchase/quorum-examples merge your work into their main repo. Perhaps in the same way that they have now diversified into constellation versus tessera.)

But for now, please try to get the 4nodes example working, as I would like to benchmark it. Your instructions up there are great, I have followed them all, plus a few more things to be removed. But now the chain is stuck, no new blocks appear.

There is a BRANCH-4nodes_log-README.md in the root folder of the archive, which shows the exact signature of the problem.

Thanks a lot!