search

uber / tchannel

network multiplexing and framing protocol for RPC
MIT License
1.15k stars 129 forks source link

Hyperbahn bad benchmark #1320

Closed rf closed 9 years ago

rf commented 9 years ago

@Raynos

Raynos commented 9 years ago

This is exciting.

Raynos commented 9 years ago

With logtron:

$ make torch-relay-bad-bench 
node index.js --bad --relay --torch relay --torchFile ./flame.raw --torchTime 10 \
    -- --bad --relay --skipPing -s 4096,16384 -p 10000,20000
running /home/raynos/uber/tchannel/hyperbahn/node_modules/tchannel/benchmarks/bench_server 28366
running /home/raynos/uber/tchannel/hyperbahn/benchmarks/hyperbahn-worker 28368
running /home/raynos/uber/tchannel/hyperbahn/node_modules/tchannel/benchmarks/multi_bench 28370
starting flaming
Sampling 28368 for 10s, outputting raw.

1:      SET 4KiB, 10000/0 min/max/avg/p95: 1278/14778/8092.07/13355.95  21947ms total,   911.29 ops/sec
1:      GET 4KiB, 10000/0 min/max/avg/p95: 1313/18034/8909.79/14994.15  22873ms total,   874.39 ops/sec
1:      SET 4KiB, 20000/0 min/max/avg/p95: 2819/23938/13453.70/23134.65  26947ms total,   742.20 ops/sec
finished flaming
1:      GET 4KiB, 20000/0 min/max/avg/p95: 2774/17906/10858.48/16837.10  19691ms total,  1015.69 ops/sec
1:     SET 16KiB, 10000/0 min/max/avg/p95: 1041/10406/7026.82/9696.75  18968ms total,  1054.41 ops/sec
1:     GET 16KiB, 10000/0 min/max/avg/p95: 1495/12467/6416.14/10574.05  16822ms total,  1188.92 ops/sec
1:     SET 16KiB, 20000/0 min/max/avg/p95: 2829/16414/9083.14/16083.20  19583ms total,  1021.29 ops/sec
1:     GET 16KiB, 20000/0 min/max/avg/p95: 2208/14906/8552.34/14009.30  16026ms total,  1247.97 ops/sec
benchmark finished

With larch:

$ make torch-relay-bad-bench 
node index.js --bad --relay --torch relay --torchFile ./flame.raw --torchTime 10 \
    -- --bad --relay --skipPing -s 4096,16384 -p 10000,20000
running /home/raynos/uber/tchannel/hyperbahn/node_modules/tchannel/benchmarks/bench_server 27569
running /home/raynos/uber/tchannel/hyperbahn/benchmarks/hyperbahn-worker 27571
running /home/raynos/uber/tchannel/hyperbahn/node_modules/tchannel/benchmarks/multi_bench 27573
starting flaming
Sampling 27571 for 10s, outputting raw.

1:      SET 4KiB, 10000/0 min/max/avg/p95: 1086/6123/3558.25/5557.30  10108ms total,  1978.63 ops/sec
1:      GET 4KiB, 10000/0 min/max/avg/p95:  789/8334/3911.03/6533.75  10349ms total,  1932.55 ops/sec
1:      SET 4KiB, 20000/0 min/max/avg/p95: 2224/10350/6212.75/10001.55  12603ms total,  1586.92 ops/sec
1:      GET 4KiB, 20000/0 min/max/avg/p95: 2158/8971/5056.65/7983.00  10851ms total,  1843.15 ops/sec
1:     SET 16KiB, 10000/0 min/max/avg/p95: 1506/8631/5898.01/8085.80  15648ms total,  1278.12 ops/sec
finished flaming
1:     GET 16KiB, 10000/0 min/max/avg/p95: 1199/9727/4820.67/7619.20  12345ms total,  1620.09 ops/sec
^CMakefile:27: recipe for target 'torch-relay-bad-bench' failed
make: *** [torch-relay-bad-bench] Error 130

With no error frames:

$ make torch-relay-bench 
node index.js --relay --torch relay --torchFile ./flame.raw --torchTime 10 \
    -- --relay --skipPing -s 4096,16384 -p 10000,20000
running /home/raynos/uber/tchannel/hyperbahn/node_modules/tchannel/benchmarks/bench_server 29944
running /home/raynos/uber/tchannel/hyperbahn/benchmarks/hyperbahn-worker 29946
running /home/raynos/uber/tchannel/hyperbahn/node_modules/tchannel/benchmarks/multi_bench 29948
1:      SET 4KiB, 10000/0 min/max/avg/p95: 1356/5236/3108.51/4406.10   8910ms total,  2244.67 ops/sec
starting flaming
Sampling 29946 for 10s, outputting raw.

1:      GET 4KiB, 10000/0 min/max/avg/p95: 1083/8605/4283.34/7895.10  10640ms total,  1879.70 ops/sec
1:      SET 4KiB, 20000/0 min/max/avg/p95: 2127/7755/4365.59/7353.20  10424ms total,  1918.65 ops/sec
1:      GET 4KiB, 20000/0 min/max/avg/p95: 2972/9090/6010.01/8370.65  10431ms total,  1917.36 ops/sec
1:     SET 16KiB, 10000/0 min/max/avg/p95: 1929/8306/5776.59/7867.55  15860ms total,  1261.03 ops/sec
1:     GET 16KiB, 10000/0 min/max/avg/p95: 1688/13296/5952.34/12546.55  14896ms total,  1342.64 ops/sec
finished flaming
1:     SET 16KiB, 20000/0 min/max/avg/p95: 3127/10347/6503.82/10060.90  14066ms total,  1421.87 ops/sec
1:     GET 16KiB, 20000/0 min/max/avg/p95: 2147/7965/5920.02/7618.40   9374ms total,  2133.56 ops/sec
benchmark finished
Raynos commented 9 years ago

Here are some flames: