search

the-guild-org / gateways-benchmark

MIT License
40 stars 7 forks source link

Update rust Docker tag to v1.77.0 #416

Closed renovate[bot] closed 4 months ago

renovate[bot] commented 4 months ago

Mend Renovate

This PR contains the following updates:

Package Type Update Change
rust stage minor 1.76.0 -> 1.77.0

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 174 5325 total, 0 failed avg: 511ms, p95: 691ms ✅
apollo-router 168 5137 total, 0 failed avg: 535ms, p95: 721ms ✅
wundergraph 154 4718 total, 0 failed avg: 531ms, p95: 962ms ✅
mesh-supergraph-bun 97 2995 total, 0 failed avg: 988ms, p95: 1705ms ✅
apollo-server 48 1507 total, 0 failed avg: 2021ms, p95: 2689ms ✅
mesh-supergraph 31 984 total, 0 failed avg: 3134ms, p95: 5182ms ✅
mercurius 29 909 total, 0 failed avg: 3353ms, p95: 4838ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15975 ✗ 0 data_received..................: 467 MB 15 MB/s data_sent......................: 6.3 MB 208 kB/s http_req_blocked...............: avg=41.72µs min=1.45µs med=2.92µs max=48.15ms p(90)=4.41µs p(95)=5.34µs http_req_connecting............: avg=28.73µs min=0s med=0s max=11.87ms p(90)=0s p(95)=0s http_req_duration..............: avg=511.49ms min=73.73ms med=512.05ms max=1.53s p(90)=620.3ms p(95)=690.9ms { expected_response:true }...: avg=511.49ms min=73.73ms med=512.05ms max=1.53s p(90)=620.3ms p(95)=690.9ms http_req_failed................: 0.00% ✓ 0 ✗ 5325 http_req_receiving.............: avg=22.44ms min=37.34µs med=74.84µs max=1.08s p(90)=39.61ms p(95)=128ms http_req_sending...............: avg=1.41ms min=8.24µs med=13.82µs max=473.35ms p(90)=36.89µs p(95)=591.32µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=487.63ms min=73.52ms med=501.51ms max=799.86ms p(90)=582.96ms p(95)=609.78ms http_reqs......................: 5325 174.91761/s iteration_duration.............: avg=567.34ms min=85.09ms med=548.08ms max=1.54s p(90)=729.11ms p(95)=851.54ms iterations.....................: 5325 174.91761/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15411 ✗ 0 data_received..................: 451 MB 15 MB/s data_sent......................: 6.1 MB 201 kB/s http_req_blocked...............: avg=47.98µs min=1.47µs med=2.97µs max=51.24ms p(90)=4.74µs p(95)=5.81µs http_req_connecting............: avg=31.17µs min=0s med=0s max=6.61ms p(90)=0s p(95)=0s http_req_duration..............: avg=534.78ms min=139.95ms med=533.02ms max=1.35s p(90)=664.32ms p(95)=720.99ms { expected_response:true }...: avg=534.78ms min=139.95ms med=533.02ms max=1.35s p(90)=664.32ms p(95)=720.99ms http_req_failed................: 0.00% ✓ 0 ✗ 5137 http_req_receiving.............: avg=12.59ms min=37.19µs med=71.64µs max=865.26ms p(90)=21.78ms p(95)=68.44ms http_req_sending...............: avg=1.12ms min=7.96µs med=13.87µs max=532.04ms p(90)=33.74µs p(95)=174.78µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=521.06ms min=139.6ms med=523.53ms max=942.03ms p(90)=645.84ms p(95)=685.39ms http_reqs......................: 5137 168.916334/s iteration_duration.............: avg=588.2ms min=190.87ms med=576.08ms max=1.68s p(90)=747.24ms p(95)=815.63ms iterations.....................: 5137 168.916334/s vus............................: 94 min=94 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14154 ✗ 0 data_received..................: 414 MB 14 MB/s data_sent......................: 5.6 MB 184 kB/s http_req_blocked...............: avg=22.39µs min=1.47µs med=3.08µs max=5.13ms p(90)=4.96µs p(95)=6.27µs http_req_connecting............: avg=14.33µs min=0s med=0s max=4.12ms p(90)=0s p(95)=0s http_req_duration..............: avg=530.93ms min=24.07ms med=507.93ms max=1.86s p(90)=837.57ms p(95)=961.58ms { expected_response:true }...: avg=530.93ms min=24.07ms med=507.93ms max=1.86s p(90)=837.57ms p(95)=961.58ms http_req_failed................: 0.00% ✓ 0 ✗ 4718 http_req_receiving.............: avg=56.93ms min=37.83µs med=93.12µs max=1.54s p(90)=183.36ms p(95)=413.51ms http_req_sending...............: avg=2.62ms min=8.28µs med=15.14µs max=853.19ms p(90)=51.67µs p(95)=723.79µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=471.38ms min=23.97ms med=455.05ms max=1.26s p(90)=749.38ms p(95)=853.3ms http_reqs......................: 4718 154.780153/s iteration_duration.............: avg=642.07ms min=44.63ms med=591.81ms max=2.98s p(90)=1.01s p(95)=1.22s iterations.....................: 4718 154.780153/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8985 ✗ 0 data_received..................: 263 MB 8.6 MB/s data_sent......................: 3.6 MB 116 kB/s http_req_blocked...............: avg=70.35µs min=1.23µs med=2.76µs max=16.98ms p(90)=4.52µs p(95)=10.18µs http_req_connecting............: avg=33.23µs min=0s med=0s max=6.64ms p(90)=0s p(95)=0s http_req_duration..............: avg=987.71ms min=309.38ms med=872.11ms max=2.62s p(90)=1.56s p(95)=1.7s { expected_response:true }...: avg=987.71ms min=309.38ms med=872.11ms max=2.62s p(90)=1.56s p(95)=1.7s http_req_failed................: 0.00% ✓ 0 ✗ 2995 http_req_receiving.............: avg=11.48ms min=37.91µs med=87.35µs max=697.16ms p(90)=3.56ms p(95)=64.16ms http_req_sending...............: avg=613.19µs min=7.84µs med=13.54µs max=304.11ms p(90)=36.33µs p(95)=216.15µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=975.62ms min=308.6ms med=866.62ms max=2.6s p(90)=1.54s p(95)=1.69s http_reqs......................: 2995 97.52875/s iteration_duration.............: avg=1.01s min=319.14ms med=894.37ms max=2.69s p(90)=1.59s p(95)=1.73s iterations.....................: 2995 97.52875/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4521 ✗ 0 data_received..................: 133 MB 4.2 MB/s data_sent......................: 1.8 MB 57 kB/s http_req_blocked...............: avg=250.19µs min=1.58µs med=3.86µs max=31.68ms p(90)=5.95µs p(95)=1.78ms http_req_connecting............: avg=220.78µs min=0s med=0s max=6.43ms p(90)=0s p(95)=1.57ms http_req_duration..............: avg=2.02s min=424.1ms med=1.67s max=21.73s p(90)=2.1s p(95)=2.68s { expected_response:true }...: avg=2.02s min=424.1ms med=1.67s max=21.73s p(90)=2.1s p(95)=2.68s http_req_failed................: 0.00% ✓ 0 ✗ 1507 http_req_receiving.............: avg=393.92µs min=45.34µs med=128.02µs max=64.72ms p(90)=187.72µs p(95)=223.51µs http_req_sending...............: avg=173.51µs min=8.27µs med=20.29µs max=43.64ms p(90)=40.61µs p(95)=608.4µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.02s min=423.47ms med=1.67s max=21.73s p(90)=2.09s p(95)=2.68s http_reqs......................: 1507 48.277415/s iteration_duration.............: avg=2.03s min=439.04ms med=1.68s max=21.73s p(90)=2.12s p(95)=2.69s iterations.....................: 1507 48.277415/s vus............................: 34 min=34 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2952 ✗ 0 data_received..................: 86 MB 2.7 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=106.45µs min=1.52µs med=3.55µs max=7.22ms p(90)=108.41µs p(95)=438.63µs http_req_connecting............: avg=90.74µs min=0s med=0s max=6.91ms p(90)=70.64µs p(95)=353µs http_req_duration..............: avg=3.13s min=997.72ms med=2.88s max=6.54s p(90)=4.57s p(95)=5.18s { expected_response:true }...: avg=3.13s min=997.72ms med=2.88s max=6.54s p(90)=4.57s p(95)=5.18s http_req_failed................: 0.00% ✓ 0 ✗ 984 http_req_receiving.............: avg=5.01ms min=41.49µs med=149.53µs max=1.69s p(90)=2.01ms p(95)=13.49ms http_req_sending...............: avg=104.04µs min=8.11µs med=19.51µs max=14.27ms p(90)=50.83µs p(95)=183.6µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.12s min=997.61ms med=2.88s max=6.54s p(90)=4.55s p(95)=5.18s http_reqs......................: 984 31.085104/s iteration_duration.............: avg=3.14s min=1.01s med=2.89s max=6.56s p(90)=4.58s p(95)=5.19s iterations.....................: 984 31.085104/s vus............................: 56 min=56 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2727 ✗ 0 data_received..................: 80 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=72.16µs min=1.87µs med=4.37µs max=8.53ms p(90)=111.82µs p(95)=308.05µs http_req_connecting............: avg=52.26µs min=0s med=0s max=8.5ms p(90)=75.8µs p(95)=250.31µs http_req_duration..............: avg=3.35s min=531.06ms med=3.16s max=8.23s p(90)=4.45s p(95)=4.83s { expected_response:true }...: avg=3.35s min=531.06ms med=3.16s max=8.23s p(90)=4.45s p(95)=4.83s http_req_failed................: 0.00% ✓ 0 ✗ 909 http_req_receiving.............: avg=402.65µs min=43.57µs med=124.43µs max=54.46ms p(90)=199.76µs p(95)=276.1µs http_req_sending...............: avg=45.34µs min=10.02µs med=25.01µs max=1.64ms p(90)=48.2µs p(95)=171.04µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.35s min=530.54ms med=3.16s max=8.23s p(90)=4.45s p(95)=4.83s http_reqs......................: 909 29.321188/s iteration_duration.............: avg=3.36s min=541.47ms med=3.17s max=8.25s p(90)=4.46s p(95)=4.84s iterations.....................: 909 29.321188/s vus............................: 3 min=3 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 151 4628 total, 0 failed avg: 607ms, p95: 789ms ✅
wundergraph 100 3102 total, 0 failed avg: 945ms, p95: 1214ms ✅
mesh-supergraph-bun 83 2603 total, 0 failed avg: 1155ms, p95: 1704ms ✅
cosmo 80 2515 total, 0 failed avg: 1186ms, p95: 1408ms ✅
apollo-server 48 1537 total, 0 failed avg: 2011ms, p95: 2386ms ✅
mesh-supergraph 30 986 total, 0 failed avg: 3154ms, p95: 5205ms ✅
mercurius 12 456 total, 0 failed avg: 7533ms, p95: 8953ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13884 ✗ 0 data_received..................: 406 MB 13 MB/s data_sent......................: 5.5 MB 180 kB/s http_req_blocked...............: avg=80.94µs min=1.21µs med=2.68µs max=49.89ms p(90)=4.06µs p(95)=5.57µs http_req_connecting............: avg=65.07µs min=0s med=0s max=6.7ms p(90)=0s p(95)=0s http_req_duration..............: avg=606.71ms min=285.37ms med=596.48ms max=1.21s p(90)=729.89ms p(95)=789.44ms { expected_response:true }...: avg=606.71ms min=285.37ms med=596.48ms max=1.21s p(90)=729.89ms p(95)=789.44ms http_req_failed................: 0.00% ✓ 0 ✗ 4628 http_req_receiving.............: avg=9.68ms min=36.19µs med=64.43µs max=413.34ms p(90)=17.66ms p(95)=70.49ms http_req_sending...............: avg=1.07ms min=7.36µs med=12.97µs max=251.67ms p(90)=30.9µs p(95)=189.14µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=595.95ms min=285.28ms med=587.33ms max=941.33ms p(90)=714.83ms p(95)=769.62ms http_reqs......................: 4628 151.807735/s iteration_duration.............: avg=654.49ms min=295.41ms med=637.58ms max=1.23s p(90)=811.05ms p(95)=881.17ms iterations.....................: 4628 151.807735/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9306 ✗ 0 data_received..................: 272 MB 8.8 MB/s data_sent......................: 3.7 MB 119 kB/s http_req_blocked...............: avg=37.85µs min=1.09µs med=2.59µs max=4.37ms p(90)=3.82µs p(95)=6.9µs http_req_connecting............: avg=29.08µs min=0s med=0s max=3.59ms p(90)=0s p(95)=0s http_req_duration..............: avg=944.85ms min=558.09ms med=924.85ms max=1.67s p(90)=1.1s p(95)=1.21s { expected_response:true }...: avg=944.85ms min=558.09ms med=924.85ms max=1.67s p(90)=1.1s p(95)=1.21s http_req_failed................: 0.00% ✓ 0 ✗ 3102 http_req_receiving.............: avg=18.15ms min=39.25µs med=98.18µs max=320.23ms p(90)=67.16ms p(95)=100.46ms http_req_sending...............: avg=1.1ms min=7.92µs med=12.75µs max=244.79ms p(90)=31.85µs p(95)=122.2µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=925.59ms min=547.05ms med=910.35ms max=1.5s p(90)=1.07s p(95)=1.14s http_reqs......................: 3102 100.511125/s iteration_duration.............: avg=984.66ms min=610.82ms med=959.93ms max=1.68s p(90)=1.16s p(95)=1.28s iterations.....................: 3102 100.511125/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7809 ✗ 0 data_received..................: 228 MB 7.3 MB/s data_sent......................: 3.1 MB 99 kB/s http_req_blocked...............: avg=59.16µs min=1.45µs med=3.49µs max=5.3ms p(90)=5.6µs p(95)=11.74µs http_req_connecting............: avg=45.2µs min=0s med=0s max=3.59ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.15s min=483.67ms med=1.11s max=2.65s p(90)=1.49s p(95)=1.7s { expected_response:true }...: avg=1.15s min=483.67ms med=1.11s max=2.65s p(90)=1.49s p(95)=1.7s http_req_failed................: 0.00% ✓ 0 ✗ 2603 http_req_receiving.............: avg=14.88ms min=38.85µs med=100.95µs max=649.31ms p(90)=860.88µs p(95)=91.13ms http_req_sending...............: avg=465.36µs min=8.3µs med=16.91µs max=98.14ms p(90)=49.45µs p(95)=411.91µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=483.57ms med=1.1s max=2.52s p(90)=1.45s p(95)=1.66s http_reqs......................: 2603 83.676024/s iteration_duration.............: avg=1.18s min=494.95ms med=1.14s max=2.66s p(90)=1.54s p(95)=1.73s iterations.....................: 2603 83.676024/s vus............................: 31 min=31 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7545 ✗ 0 data_received..................: 221 MB 7.1 MB/s data_sent......................: 3.0 MB 96 kB/s http_req_blocked...............: avg=38.74µs min=1.25µs med=2.44µs max=3.29ms p(90)=3.72µs p(95)=9.47µs http_req_connecting............: avg=33.41µs min=0s med=0s max=3.04ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.18s min=752.89ms med=1.18s max=1.6s p(90)=1.36s p(95)=1.4s { expected_response:true }...: avg=1.18s min=752.89ms med=1.18s max=1.6s p(90)=1.36s p(95)=1.4s http_req_failed................: 0.00% ✓ 0 ✗ 2515 http_req_receiving.............: avg=14.9ms min=36.26µs med=88.63µs max=308.24ms p(90)=63.23ms p(95)=95.27ms http_req_sending...............: avg=1.7ms min=7.23µs med=12.67µs max=243.29ms p(90)=75.75µs p(95)=541.15µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.16s min=752.72ms med=1.17s max=1.56s p(90)=1.33s p(95)=1.37s http_reqs......................: 2515 80.486841/s iteration_duration.............: avg=1.22s min=775.17ms med=1.22s max=1.74s p(90)=1.41s p(95)=1.46s iterations.....................: 2515 80.486841/s vus............................: 23 min=23 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4611 ✗ 0 data_received..................: 135 MB 4.3 MB/s data_sent......................: 1.8 MB 58 kB/s http_req_blocked...............: avg=48.25µs min=1.54µs med=3.14µs max=2.11ms p(90)=5.27µs p(95)=243.29µs http_req_connecting............: avg=42.55µs min=0s med=0s max=2.07ms p(90)=0s p(95)=178.14µs http_req_duration..............: avg=2.01s min=918.64ms med=1.8s max=13.84s p(90)=2.18s p(95)=2.38s { expected_response:true }...: avg=2.01s min=918.64ms med=1.8s max=13.84s p(90)=2.18s p(95)=2.38s http_req_failed................: 0.00% ✓ 0 ✗ 1537 http_req_receiving.............: avg=159.25µs min=48.16µs med=118.08µs max=14.32ms p(90)=180.94µs p(95)=214.14µs http_req_sending...............: avg=80.82µs min=8.7µs med=17µs max=25.02ms p(90)=33.72µs p(95)=154.01µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.01s min=918.4ms med=1.8s max=13.84s p(90)=2.18s p(95)=2.38s http_reqs......................: 1537 48.58917/s iteration_duration.............: avg=2.02s min=925.84ms med=1.81s max=13.85s p(90)=2.2s p(95)=2.39s iterations.....................: 1537 48.58917/s vus............................: 76 min=76 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2958 ✗ 0 data_received..................: 87 MB 2.7 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=95.27µs min=1.35µs med=3.57µs max=3.42ms p(90)=84.29µs p(95)=218.83µs http_req_connecting............: avg=75.77µs min=0s med=0s max=3.36ms p(90)=56.04µs p(95)=173.99µs http_req_duration..............: avg=3.15s min=922.35ms med=3.09s max=7.2s p(90)=4.45s p(95)=5.2s { expected_response:true }...: avg=3.15s min=922.35ms med=3.09s max=7.2s p(90)=4.45s p(95)=5.2s http_req_failed................: 0.00% ✓ 0 ✗ 986 http_req_receiving.............: avg=3.34ms min=44.04µs med=159.71µs max=100.53ms p(90)=2.04ms p(95)=11.63ms http_req_sending...............: avg=71.42µs min=8.65µs med=19.51µs max=30.79ms p(90)=52.32µs p(95)=142.89µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.15s min=922.24ms med=3.09s max=7.2s p(90)=4.4s p(95)=5.2s http_reqs......................: 986 30.887282/s iteration_duration.............: avg=3.16s min=928.62ms med=3.1s max=7.23s p(90)=4.47s p(95)=5.21s iterations.....................: 986 30.887282/s vus............................: 72 min=72 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1368 ✗ 0 data_received..................: 40 MB 1.1 MB/s data_sent......................: 541 kB 14 kB/s http_req_blocked...............: avg=363.5µs min=1.36µs med=3.16µs max=4.93ms p(90)=1.26ms p(95)=2.94ms http_req_connecting............: avg=326.67µs min=0s med=0s max=4.73ms p(90)=1.15ms p(95)=2.6ms http_req_duration..............: avg=7.53s min=3.07s med=7.77s max=9.11s p(90)=8.87s p(95)=8.95s { expected_response:true }...: avg=7.53s min=3.07s med=7.77s max=9.11s p(90)=8.87s p(95)=8.95s http_req_failed................: 0.00% ✓ 0 ✗ 456 http_req_receiving.............: avg=156.94µs min=59.51µs med=114.48µs max=7.52ms p(90)=183.79µs p(95)=220.52µs http_req_sending...............: avg=50.95µs min=8.38µs med=18.73µs max=1.05ms p(90)=194.93µs p(95)=242.23µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.53s min=3.07s med=7.77s max=9.11s p(90)=8.87s p(95)=8.95s http_reqs......................: 456 12.013933/s iteration_duration.............: avg=7.54s min=3.08s med=7.78s max=9.12s p(90)=8.88s p(95)=8.96s iterations.....................: 456 12.013933/s vus............................: 19 min=19 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 159 4895 total, 0 failed avg: 550ms, p95: 747ms ✅
wundergraph 103 3179 total, 0 failed avg: 917ms, p95: 1139ms ✅
mesh-supergraph-bun 100 3087 total, 0 failed avg: 948ms, p95: 1333ms ✅
cosmo 81 2556 total, 0 failed avg: 1157ms, p95: 1439ms ✅
mesh-supergraph 67 2088 total, 0 failed avg: 1439ms, p95: 2248ms ✅
apollo-server 64 2008 total, 0 failed avg: 1521ms, p95: 1895ms ✅
mercurius 12 475 total, 0 failed avg: 7129ms, p95: 8396ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14685 ✗ 0 data_received..................: 429 MB 14 MB/s data_sent......................: 5.8 MB 189 kB/s http_req_blocked...............: avg=39.53µs min=1.62µs med=3.57µs max=59.41ms p(90)=5.85µs p(95)=7.61µs http_req_connecting............: avg=19.47µs min=0s med=0s max=5.03ms p(90)=0s p(95)=0s http_req_duration..............: avg=550.48ms min=257.61ms med=538.71ms max=1.25s p(90)=686.71ms p(95)=746.82ms { expected_response:true }...: avg=550.48ms min=257.61ms med=538.71ms max=1.25s p(90)=686.71ms p(95)=746.82ms http_req_failed................: 0.00% ✓ 0 ✗ 4895 http_req_receiving.............: avg=18.21ms min=39.17µs med=89.71µs max=657.98ms p(90)=68.38ms p(95)=122.79ms http_req_sending...............: avg=1.64ms min=8.48µs med=17.12µs max=367.72ms p(90)=53.76µs p(95)=399.82µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=530.62ms min=257.52ms med=524.75ms max=1.02s p(90)=652.43ms p(95)=694.77ms http_reqs......................: 4895 159.091999/s iteration_duration.............: avg=618.39ms min=295.75ms med=597.41ms max=1.37s p(90)=792.17ms p(95)=887.76ms iterations.....................: 4895 159.091999/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9537 ✗ 0 data_received..................: 279 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=27.83µs min=1.31µs med=2.75µs max=2.93ms p(90)=4.3µs p(95)=8.6µs http_req_connecting............: avg=22.99µs min=0s med=0s max=2.9ms p(90)=0s p(95)=0s http_req_duration..............: avg=916.61ms min=520.32ms med=910.68ms max=1.39s p(90)=1.08s p(95)=1.13s { expected_response:true }...: avg=916.61ms min=520.32ms med=910.68ms max=1.39s p(90)=1.08s p(95)=1.13s http_req_failed................: 0.00% ✓ 0 ✗ 3179 http_req_receiving.............: avg=16.79ms min=38.93µs med=98.48µs max=356.81ms p(90)=64.1ms p(95)=106.29ms http_req_sending...............: avg=1.34ms min=7.46µs med=13.17µs max=297.44ms p(90)=43.89µs p(95)=408.78µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=898.47ms min=520.24ms med=895.74ms max=1.25s p(90)=1.05s p(95)=1.1s http_reqs......................: 3179 103.009486/s iteration_duration.............: avg=960.45ms min=530.04ms med=951.19ms max=1.45s p(90)=1.14s p(95)=1.21s iterations.....................: 3179 103.009486/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9261 ✗ 0 data_received..................: 271 MB 8.8 MB/s data_sent......................: 3.7 MB 119 kB/s http_req_blocked...............: avg=70.16µs min=1.62µs med=3.5µs max=9.27ms p(90)=5.5µs p(95)=10.48µs http_req_connecting............: avg=54.32µs min=0s med=0s max=7.08ms p(90)=0s p(95)=0s http_req_duration..............: avg=948.33ms min=432.89ms med=924.13ms max=2.32s p(90)=1.22s p(95)=1.33s { expected_response:true }...: avg=948.33ms min=432.89ms med=924.13ms max=2.32s p(90)=1.22s p(95)=1.33s http_req_failed................: 0.00% ✓ 0 ✗ 3087 http_req_receiving.............: avg=14.05ms min=40.5µs med=98.02µs max=565.46ms p(90)=4.49ms p(95)=63.79ms http_req_sending...............: avg=729.56µs min=8.75µs med=16.62µs max=434.96ms p(90)=54.39µs p(95)=383.57µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=933.55ms min=432.56ms med=913.21ms max=2.32s p(90)=1.19s p(95)=1.29s http_reqs......................: 3087 100.326226/s iteration_duration.............: avg=984.95ms min=443.25ms med=959.11ms max=2.34s p(90)=1.28s p(95)=1.39s iterations.....................: 3087 100.326226/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7668 ✗ 0 data_received..................: 224 MB 7.2 MB/s data_sent......................: 3.0 MB 97 kB/s http_req_blocked...............: avg=24.8µs min=1.36µs med=2.83µs max=2.16ms p(90)=4.51µs p(95)=9.73µs http_req_connecting............: avg=19.11µs min=0s med=0s max=1.5ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.15s min=660.73ms med=1.15s max=1.76s p(90)=1.37s p(95)=1.43s { expected_response:true }...: avg=1.15s min=660.73ms med=1.15s max=1.76s p(90)=1.37s p(95)=1.43s http_req_failed................: 0.00% ✓ 0 ✗ 2556 http_req_receiving.............: avg=12.4ms min=41.13µs med=90.63µs max=345.59ms p(90)=48.12ms p(95)=82.72ms http_req_sending...............: avg=1.72ms min=8.16µs med=13.27µs max=218.74ms p(90)=43.95µs p(95)=367.19µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=660.66ms med=1.14s max=1.65s p(90)=1.34s p(95)=1.4s http_reqs......................: 2556 81.895013/s iteration_duration.............: avg=1.19s min=679.49ms med=1.19s max=1.84s p(90)=1.42s p(95)=1.49s iterations.....................: 2556 81.895013/s vus............................: 5 min=5 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6264 ✗ 0 data_received..................: 183 MB 5.9 MB/s data_sent......................: 2.5 MB 80 kB/s http_req_blocked...............: avg=102.43µs min=1.36µs med=3.36µs max=11.26ms p(90)=4.96µs p(95)=23.72µs http_req_connecting............: avg=86.41µs min=0s med=0s max=4.89ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.43s min=634.89ms med=1.31s max=3.49s p(90)=2.04s p(95)=2.24s { expected_response:true }...: avg=1.43s min=634.89ms med=1.31s max=3.49s p(90)=2.04s p(95)=2.24s http_req_failed................: 0.00% ✓ 0 ✗ 2088 http_req_receiving.............: avg=1.31ms min=34.65µs med=104.62µs max=54.79ms p(90)=1.22ms p(95)=7.91ms http_req_sending...............: avg=130.32µs min=8.16µs med=17.33µs max=48.52ms p(90)=34.02µs p(95)=189.2µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.43s min=634.78ms med=1.31s max=3.49s p(90)=2.03s p(95)=2.24s http_reqs......................: 2088 67.523852/s iteration_duration.............: avg=1.45s min=662.95ms med=1.34s max=3.52s p(90)=2.06s p(95)=2.27s iterations.....................: 2088 67.523852/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6024 ✗ 0 data_received..................: 177 MB 5.7 MB/s data_sent......................: 2.4 MB 76 kB/s http_req_blocked...............: avg=175.95µs min=1.51µs med=3.14µs max=6.22ms p(90)=5.03µs p(95)=71.13µs http_req_connecting............: avg=168.52µs min=0s med=0s max=6.13ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.52s min=767.76ms med=1.44s max=9.47s p(90)=1.7s p(95)=1.89s { expected_response:true }...: avg=1.52s min=767.76ms med=1.44s max=9.47s p(90)=1.7s p(95)=1.89s http_req_failed................: 0.00% ✓ 0 ✗ 2008 http_req_receiving.............: avg=182.13µs min=50.27µs med=110.54µs max=48.6ms p(90)=183.59µs p(95)=244.61µs http_req_sending...............: avg=58.43µs min=8.75µs med=16.18µs max=17.82ms p(90)=34.22µs p(95)=131.22µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.52s min=764.08ms med=1.44s max=9.47s p(90)=1.7s p(95)=1.89s http_reqs......................: 2008 64.341734/s iteration_duration.............: avg=1.53s min=778.09ms med=1.45s max=9.48s p(90)=1.71s p(95)=1.91s iterations.....................: 2008 64.341734/s vus............................: 38 min=38 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1425 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 564 kB 15 kB/s http_req_blocked...............: avg=308.15µs min=1.6µs med=3.66µs max=5.5ms p(90)=915.93µs p(95)=2.01ms http_req_connecting............: avg=292.64µs min=0s med=0s max=5.46ms p(90)=862.71µs p(95)=1.97ms http_req_duration..............: avg=7.12s min=2.87s med=7.42s max=8.69s p(90)=8.27s p(95)=8.39s { expected_response:true }...: avg=7.12s min=2.87s med=7.42s max=8.69s p(90)=8.27s p(95)=8.39s http_req_failed................: 0.00% ✓ 0 ✗ 475 http_req_receiving.............: avg=142.04µs min=65.47µs med=124.73µs max=1.35ms p(90)=185.26µs p(95)=228.07µs http_req_sending...............: avg=129.19µs min=8.99µs med=21.2µs max=1.28ms p(90)=422.43µs p(95)=1.05ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.12s min=2.87s med=7.42s max=8.69s p(90)=8.27s p(95)=8.39s http_reqs......................: 475 12.750063/s iteration_duration.............: avg=7.13s min=2.87s med=7.42s max=8.7s p(90)=8.28s p(95)=8.4s iterations.....................: 475 12.750063/s vus............................: 6 min=6 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2628ms 172 12055 total, 0 failed avg: 866ms, p95: 2629ms, max: 8672ms, med: 572ms ✅
apollo-router 3014ms 173 12113 total, 0 failed avg: 908ms, p95: 3014ms, max: 10022ms, med: 516ms ✅
wundergraph 3262ms 164 11535 total, 0 failed avg: 887ms, p95: 3262ms, max: 10943ms, med: 462ms ✅
mesh-supergraph-bun 5653ms 117 8238 total, 0 failed avg: 2213ms, p95: 5653ms, max: 8642ms, med: 2087ms ✅
mesh-supergraph 7304ms 62 4353 total, 0 failed avg: 4414ms, p95: 7305ms, max: 8925ms, med: 4523ms ✅
apollo-server 23538ms 68 5044 total, 0 failed avg: 4132ms, p95: 23539ms, max: 44901ms, med: 2212ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36165 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 204 kB/s http_req_blocked...............: avg=18.36ms min=1.54µs med=3.22µs max=2.99s p(90)=5.29µs p(95)=13.47µs http_req_connecting............: avg=17.49ms min=0s med=0s max=2.9s p(90)=0s p(95)=0s http_req_duration..............: avg=866.25ms min=8.35ms med=572.15ms max=8.67s p(90)=2.09s p(95)=2.62s { expected_response:true }...: avg=866.25ms min=8.35ms med=572.15ms max=8.67s p(90)=2.09s p(95)=2.62s http_req_failed................: 0.00% ✓ 0 ✗ 12055 http_req_receiving.............: avg=372.95ms min=33.01µs med=87.37µs max=7.49s p(90)=1.45s p(95)=2.03s http_req_sending...............: avg=35.02ms min=7.55µs med=15.18µs max=6.21s p(90)=469.16µs p(95)=76.36ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=458.27ms min=8.24ms med=361.59ms max=2.81s p(90)=951.86ms p(95)=1.15s http_reqs......................: 12055 172.211787/s iteration_duration.............: avg=1.53s min=18.59ms med=954.25ms max=12.52s p(90)=3.71s p(95)=4.7s iterations.....................: 12055 172.211787/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36339 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 205 kB/s http_req_blocked...............: avg=17.85ms min=1.53µs med=3.03µs max=5.39s p(90)=5µs p(95)=12.71µs http_req_connecting............: avg=16.39ms min=0s med=0s max=4.31s p(90)=0s p(95)=0s http_req_duration..............: avg=908.14ms min=5.94ms med=515.54ms max=10.02s p(90)=2.1s p(95)=3.01s { expected_response:true }...: avg=908.14ms min=5.94ms med=515.54ms max=10.02s p(90)=2.1s p(95)=3.01s http_req_failed................: 0.00% ✓ 0 ✗ 12113 http_req_receiving.............: avg=412.79ms min=29.78µs med=84.23µs max=8.08s p(90)=1.51s p(95)=2.36s http_req_sending...............: avg=35.5ms min=8.12µs med=14.35µs max=5.81s p(90)=157.42µs p(95)=42.64ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=459.84ms min=5.82ms med=365.52ms max=1.97s p(90)=976.98ms p(95)=1.21s http_reqs......................: 12113 173.024508/s iteration_duration.............: avg=1.53s min=11.67ms med=931.57ms max=15.03s p(90)=3.81s p(95)=4.93s iterations.....................: 12113 173.024508/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34605 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 196 kB/s http_req_blocked...............: avg=20.92ms min=1.52µs med=3.1µs max=6.45s p(90)=5.02µs p(95)=17.89µs http_req_connecting............: avg=19.11ms min=0s med=0s max=6.45s p(90)=0s p(95)=0s http_req_duration..............: avg=886.66ms min=7.59ms med=461.73ms max=10.94s p(90)=2.41s p(95)=3.26s { expected_response:true }...: avg=886.66ms min=7.59ms med=461.73ms max=10.94s p(90)=2.41s p(95)=3.26s http_req_failed................: 0.00% ✓ 0 ✗ 11535 http_req_receiving.............: avg=432.97ms min=34.32µs med=85.54µs max=10.18s p(90)=1.75s p(95)=2.63s http_req_sending...............: avg=45.34ms min=8.04µs med=14.26µs max=5.33s p(90)=272.62µs p(95)=64.1ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=408.34ms min=7.5ms med=318.02ms max=4.32s p(90)=857.01ms p(95)=1.01s http_reqs......................: 11535 164.766144/s iteration_duration.............: avg=1.6s min=13.41ms med=861.8ms max=16.74s p(90)=4.16s p(95)=5.36s iterations.....................: 11535 164.766144/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24714 ✗ 0 data_received..................: 723 MB 10 MB/s data_sent......................: 9.8 MB 140 kB/s http_req_blocked...............: avg=1.96ms min=1.4µs med=2.98µs max=379.15ms p(90)=5.1µs p(95)=224.34µs http_req_connecting............: avg=1.95ms min=0s med=0s max=379.05ms p(90)=0s p(95)=151.87µs http_req_duration..............: avg=2.21s min=6.59ms med=2.08s max=8.64s p(90)=4.44s p(95)=5.65s { expected_response:true }...: avg=2.21s min=6.59ms med=2.08s max=8.64s p(90)=4.44s p(95)=5.65s http_req_failed................: 0.00% ✓ 0 ✗ 8238 http_req_receiving.............: avg=30.61ms min=33.64µs med=75.42µs max=1.64s p(90)=21.81ms p(95)=201.36ms http_req_sending...............: avg=3.44ms min=8µs med=14.05µs max=947.65ms p(90)=123.89µs p(95)=9.88ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.17s min=6.41ms med=2.04s max=8.64s p(90)=4.4s p(95)=5.43s http_reqs......................: 8238 117.669778/s iteration_duration.............: avg=2.28s min=12.03ms med=2.14s max=8.96s p(90)=4.6s p(95)=5.71s iterations.....................: 8238 117.669778/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13059 ✗ 0 data_received..................: 382 MB 5.5 MB/s data_sent......................: 5.2 MB 74 kB/s http_req_blocked...............: avg=368.71µs min=1.81µs med=5.06µs max=203.44ms p(90)=217.59µs p(95)=479.44µs http_req_connecting............: avg=296.66µs min=0s med=0s max=84.11ms p(90)=151.89µs p(95)=404.98µs http_req_duration..............: avg=4.41s min=12.94ms med=4.52s max=8.92s p(90)=6.81s p(95)=7.3s { expected_response:true }...: avg=4.41s min=12.94ms med=4.52s max=8.92s p(90)=6.81s p(95)=7.3s http_req_failed................: 0.00% ✓ 0 ✗ 4353 http_req_receiving.............: avg=6.51ms min=40.26µs med=131.63µs max=556.8ms p(90)=3.12ms p(95)=13.06ms http_req_sending...............: avg=350.42µs min=8.94µs med=28.3µs max=113.94ms p(90)=61.87µs p(95)=101.89µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.4s min=12.8ms med=4.51s max=8.72s p(90)=6.8s p(95)=7.28s http_reqs......................: 4353 62.165809/s iteration_duration.............: avg=4.44s min=18.79ms med=4.54s max=8.94s p(90)=6.88s p(95)=7.42s iterations.....................: 4353 62.165809/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15132 ✗ 0 data_received..................: 443 MB 6.1 MB/s data_sent......................: 6.0 MB 82 kB/s http_req_blocked...............: avg=94.12µs min=1.35µs med=3.22µs max=28.96ms p(90)=31.4µs p(95)=304.11µs http_req_connecting............: avg=81.02µs min=0s med=0s max=28.89ms p(90)=0s p(95)=228.39µs http_req_duration..............: avg=4.13s min=92.58ms med=2.21s max=44.9s p(90)=3.55s p(95)=23.53s { expected_response:true }...: avg=4.13s min=92.58ms med=2.21s max=44.9s p(90)=3.55s p(95)=23.53s http_req_failed................: 0.00% ✓ 0 ✗ 5044 http_req_receiving.............: avg=248.49µs min=45.37µs med=116.2µs max=163.1ms p(90)=176.63µs p(95)=206.27µs http_req_sending...............: avg=86.07µs min=8.53µs med=16.66µs max=22.94ms p(90)=41.46µs p(95)=61.65µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.13s min=92.43ms med=2.21s max=44.9s p(90)=3.55s p(95)=23.53s http_reqs......................: 5044 68.936266/s iteration_duration.............: avg=4.14s min=104.6ms med=2.22s max=44.91s p(90)=3.56s p(95)=23.57s iterations.....................: 5044 68.936266/s vus............................: 19 min=19 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview