search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency @types/node to v20.11.26 #388

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@types/node (source) 20.11.25 -> 20.11.26 age adoption passing confidence

[!WARNING] Some dependencies could not be looked up. Check the Dependency Dashboard for more information.

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 175 5346 total, 0 failed avg: 500ms, p95: 675ms ✅
apollo-router 170 5194 total, 0 failed avg: 537ms, p95: 705ms ✅
wundergraph 159 4859 total, 0 failed avg: 517ms, p95: 927ms ✅
mesh-supergraph-bun 96 2977 total, 0 failed avg: 998ms, p95: 1732ms ✅
apollo-server 49 1555 total, 0 failed avg: 1961ms, p95: 2507ms ✅
mesh-supergraph 30 949 total, 0 failed avg: 3253ms, p95: 5318ms ✅
mercurius 29 913 total, 0 failed avg: 3334ms, p95: 4371ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16038 ✗ 0 data_received..................: 469 MB 15 MB/s data_sent......................: 6.3 MB 209 kB/s http_req_blocked...............: avg=36.4µs min=1.19µs med=2.71µs max=30.75ms p(90)=4.01µs p(95)=4.94µs http_req_connecting............: avg=18.21µs min=0s med=0s max=3.72ms p(90)=0s p(95)=0s http_req_duration..............: avg=499.68ms min=38.13ms med=497.64ms max=1.81s p(90)=604.8ms p(95)=674.57ms { expected_response:true }...: avg=499.68ms min=38.13ms med=497.64ms max=1.81s p(90)=604.8ms p(95)=674.57ms http_req_failed................: 0.00% ✓ 0 ✗ 5346 http_req_receiving.............: avg=26.55ms min=35.77µs med=71.3µs max=1.26s p(90)=57.12ms p(95)=187.32ms http_req_sending...............: avg=1.52ms min=7.37µs med=12.98µs max=447.88ms p(90)=35.02µs p(95)=573.22µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=471.6ms min=37.84ms med=487.34ms max=741.8ms p(90)=569.22ms p(95)=595.41ms http_reqs......................: 5346 175.796657/s iteration_duration.............: avg=565.56ms min=48.18ms med=537.55ms max=2.03s p(90)=731.61ms p(95)=880.63ms iterations.....................: 5346 175.796657/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15582 ✗ 0 data_received..................: 456 MB 15 MB/s data_sent......................: 6.2 MB 202 kB/s http_req_blocked...............: avg=62.76µs min=1.42µs med=2.72µs max=7.31ms p(90)=4.01µs p(95)=4.97µs http_req_connecting............: avg=58.12µs min=0s med=0s max=7.25ms p(90)=0s p(95)=0s http_req_duration..............: avg=536.57ms min=190.09ms med=529.87ms max=1.26s p(90)=655.49ms p(95)=705ms { expected_response:true }...: avg=536.57ms min=190.09ms med=529.87ms max=1.26s p(90)=655.49ms p(95)=705ms http_req_failed................: 0.00% ✓ 0 ✗ 5194 http_req_receiving.............: avg=10.58ms min=34.63µs med=65.21µs max=435.39ms p(90)=16.44ms p(95)=66.77ms http_req_sending...............: avg=1.06ms min=7.93µs med=13.11µs max=569.33ms p(90)=27.89µs p(95)=138.13µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=524.91ms min=190.02ms med=523.34ms max=884.53ms p(90)=638.16ms p(95)=677.16ms http_reqs......................: 5194 170.44618/s iteration_duration.............: avg=583.61ms min=233.91ms med=567.75ms max=1.46s p(90)=733.93ms p(95)=810.99ms iterations.....................: 5194 170.44618/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14577 ✗ 0 data_received..................: 426 MB 14 MB/s data_sent......................: 5.8 MB 189 kB/s http_req_blocked...............: avg=173.25µs min=1.29µs med=2.65µs max=316.77ms p(90)=4.19µs p(95)=5.6µs http_req_connecting............: avg=88.6µs min=0s med=0s max=224.89ms p(90)=0s p(95)=0s http_req_duration..............: avg=516.63ms min=20.98ms med=482.32ms max=2.28s p(90)=822.75ms p(95)=926.52ms { expected_response:true }...: avg=516.63ms min=20.98ms med=482.32ms max=2.28s p(90)=822.75ms p(95)=926.52ms http_req_failed................: 0.00% ✓ 0 ✗ 4859 http_req_receiving.............: avg=51.96ms min=38.33µs med=88.41µs max=1.84s p(90)=184.45ms p(95)=334.03ms http_req_sending...............: avg=3.69ms min=7.89µs med=13.01µs max=1.86s p(90)=34.75µs p(95)=828.9µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=460.97ms min=19.18ms med=443.09ms max=1.36s p(90)=739.8ms p(95)=833.54ms http_reqs......................: 4859 159.528987/s iteration_duration.............: avg=621.98ms min=30.68ms med=554.92ms max=3.61s p(90)=985.87ms p(95)=1.2s iterations.....................: 4859 159.528987/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8931 ✗ 0 data_received..................: 261 MB 8.5 MB/s data_sent......................: 3.5 MB 115 kB/s http_req_blocked...............: avg=84.03µs min=1.33µs med=2.79µs max=15.65ms p(90)=4.45µs p(95)=9.17µs http_req_connecting............: avg=74.23µs min=0s med=0s max=9.36ms p(90)=0s p(95)=0s http_req_duration..............: avg=997.8ms min=394.35ms med=868.89ms max=2.38s p(90)=1.61s p(95)=1.73s { expected_response:true }...: avg=997.8ms min=394.35ms med=868.89ms max=2.38s p(90)=1.61s p(95)=1.73s http_req_failed................: 0.00% ✓ 0 ✗ 2977 http_req_receiving.............: avg=11.37ms min=34.08µs med=95.2µs max=566.77ms p(90)=1.38ms p(95)=70.21ms http_req_sending...............: avg=850.51µs min=8.14µs med=13.84µs max=174.72ms p(90)=43.03µs p(95)=328.16µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=985.57ms min=394.29ms med=858.99ms max=2.38s p(90)=1.6s p(95)=1.73s http_reqs......................: 2977 96.725905/s iteration_duration.............: avg=1.02s min=408.93ms med=896.6ms max=2.43s p(90)=1.64s p(95)=1.76s iterations.....................: 2977 96.725905/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4665 ✗ 0 data_received..................: 137 MB 4.4 MB/s data_sent......................: 1.8 MB 59 kB/s http_req_blocked...............: avg=186.3µs min=1.52µs med=2.94µs max=7.02ms p(90)=4.98µs p(95)=1.18ms http_req_connecting............: avg=180.28µs min=0s med=0s max=6.97ms p(90)=0s p(95)=1.16ms http_req_duration..............: avg=1.96s min=760.28ms med=1.63s max=20.11s p(90)=2s p(95)=2.5s { expected_response:true }...: avg=1.96s min=760.28ms med=1.63s max=20.11s p(90)=2s p(95)=2.5s http_req_failed................: 0.00% ✓ 0 ✗ 1555 http_req_receiving.............: avg=219.98µs min=47.56µs med=117.48µs max=68.46ms p(90)=175.28µs p(95)=206.02µs http_req_sending...............: avg=38.49µs min=8.59µs med=15.43µs max=776.39µs p(90)=32.32µs p(95)=124.43µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.96s min=760.18ms med=1.63s max=20.11s p(90)=2s p(95)=2.5s http_reqs......................: 1555 49.959064/s iteration_duration.............: avg=1.97s min=771.15ms med=1.64s max=20.12s p(90)=2.01s p(95)=2.51s iterations.....................: 1555 49.959064/s vus............................: 14 min=14 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2847 ✗ 0 data_received..................: 83 MB 2.6 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=265.13µs min=1.44µs med=3.82µs max=5.72ms p(90)=145.69µs p(95)=2.47ms http_req_connecting............: avg=254.79µs min=0s med=0s max=5.57ms p(90)=89.52µs p(95)=2.43ms http_req_duration..............: avg=3.25s min=1.17s med=3.18s max=6.79s p(90)=4.69s p(95)=5.31s { expected_response:true }...: avg=3.25s min=1.17s med=3.18s max=6.79s p(90)=4.69s p(95)=5.31s http_req_failed................: 0.00% ✓ 0 ✗ 949 http_req_receiving.............: avg=2.29ms min=39.59µs med=149.4µs max=89.57ms p(90)=780.08µs p(95)=5.59ms http_req_sending...............: avg=67.77µs min=8.34µs med=21.1µs max=17.65ms p(90)=88.04µs p(95)=172.42µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.25s min=1.12s med=3.18s max=6.79s p(90)=4.69s p(95)=5.31s http_reqs......................: 949 30.006142/s iteration_duration.............: avg=3.26s min=1.18s med=3.2s max=6.8s p(90)=4.71s p(95)=5.32s iterations.....................: 949 30.006142/s vus............................: 60 min=60 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2739 ✗ 0 data_received..................: 80 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=170.17µs min=1.57µs med=3.75µs max=5.95ms p(90)=118.9µs p(95)=1.2ms http_req_connecting............: avg=155.82µs min=0s med=0s max=5.89ms p(90)=87.29µs p(95)=1.1ms http_req_duration..............: avg=3.33s min=1.14s med=3.13s max=7.27s p(90)=4.17s p(95)=4.37s { expected_response:true }...: avg=3.33s min=1.14s med=3.13s max=7.27s p(90)=4.17s p(95)=4.37s http_req_failed................: 0.00% ✓ 0 ✗ 913 http_req_receiving.............: avg=329.01µs min=45.24µs med=120.08µs max=78.48ms p(90)=188.09µs p(95)=252.94µs http_req_sending...............: avg=52.91µs min=9.78µs med=20.81µs max=715.74µs p(90)=46.11µs p(95)=280.25µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.33s min=1.14s med=3.13s max=7.27s p(90)=4.17s p(95)=4.37s http_reqs......................: 913 29.509815/s iteration_duration.............: avg=3.34s min=1.15s med=3.14s max=7.27s p(90)=4.18s p(95)=4.37s iterations.....................: 913 29.509815/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 169 5171 total, 0 failed avg: 525ms, p95: 690ms ✅
wundergraph 105 3244 total, 0 failed avg: 904ms, p95: 1105ms ✅
mesh-supergraph-bun 99 3069 total, 0 failed avg: 954ms, p95: 1382ms ✅
cosmo 81 2531 total, 0 failed avg: 1168ms, p95: 1472ms ✅
apollo-server 64 2011 total, 0 failed avg: 1527ms, p95: 1752ms ✅
mesh-supergraph 61 1903 total, 0 failed avg: 1582ms, p95: 2327ms ✅
mercurius 12 474 total, 0 failed avg: 7112ms, p95: 8389ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15513 ✗ 0 data_received..................: 454 MB 15 MB/s data_sent......................: 6.1 MB 201 kB/s http_req_blocked...............: avg=80.31µs min=1.28µs med=2.74µs max=151.98ms p(90)=4.14µs p(95)=5.17µs http_req_connecting............: avg=29.45µs min=0s med=0s max=4.48ms p(90)=0s p(95)=0s http_req_duration..............: avg=525.46ms min=276.28ms med=516.41ms max=962.47ms p(90)=646.26ms p(95)=689.76ms { expected_response:true }...: avg=525.46ms min=276.28ms med=516.41ms max=962.47ms p(90)=646.26ms p(95)=689.76ms http_req_failed................: 0.00% ✓ 0 ✗ 5171 http_req_receiving.............: avg=14.78ms min=36.64µs med=70.47µs max=361.34ms p(90)=52.59ms p(95)=100.4ms http_req_sending...............: avg=1.49ms min=8.43µs med=13.28µs max=261.3ms p(90)=44.73µs p(95)=718.58µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=509.18ms min=264.36ms med=505.68ms max=923.76ms p(90)=614.37ms p(95)=645.11ms http_reqs......................: 5171 169.694235/s iteration_duration.............: avg=585ms min=285.65ms med=572.68ms max=1.09s p(90)=742.72ms p(95)=800.61ms iterations.....................: 5171 169.694235/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9732 ✗ 0 data_received..................: 285 MB 9.2 MB/s data_sent......................: 3.9 MB 125 kB/s http_req_blocked...............: avg=42.69µs min=1.24µs med=2.58µs max=10.17ms p(90)=4.12µs p(95)=8.27µs http_req_connecting............: avg=31.08µs min=0s med=0s max=3.63ms p(90)=0s p(95)=0s http_req_duration..............: avg=904.21ms min=558.59ms med=890.02ms max=1.49s p(90)=1.05s p(95)=1.1s { expected_response:true }...: avg=904.21ms min=558.59ms med=890.02ms max=1.49s p(90)=1.05s p(95)=1.1s http_req_failed................: 0.00% ✓ 0 ✗ 3244 http_req_receiving.............: avg=10.91ms min=39.4µs med=86.39µs max=312.08ms p(90)=34.84ms p(95)=74.26ms http_req_sending...............: avg=1.57ms min=8.08µs med=12.91µs max=227.5ms p(90)=45.16µs p(95)=466.43µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=891.72ms min=558.53ms med=881.31ms max=1.3s p(90)=1.03s p(95)=1.09s http_reqs......................: 3244 105.293004/s iteration_duration.............: avg=941.45ms min=596.59ms med=923.6ms max=1.51s p(90)=1.11s p(95)=1.16s iterations.....................: 3244 105.293004/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9207 ✗ 0 data_received..................: 269 MB 8.7 MB/s data_sent......................: 3.6 MB 118 kB/s http_req_blocked...............: avg=53.56µs min=1.8µs med=3.7µs max=6.79ms p(90)=5.82µs p(95)=11.62µs http_req_connecting............: avg=44.91µs min=0s med=0s max=5.61ms p(90)=0s p(95)=0s http_req_duration..............: avg=954.11ms min=412.88ms med=928.5ms max=2.11s p(90)=1.25s p(95)=1.38s { expected_response:true }...: avg=954.11ms min=412.88ms med=928.5ms max=2.11s p(90)=1.25s p(95)=1.38s http_req_failed................: 0.00% ✓ 0 ✗ 3069 http_req_receiving.............: avg=15.44ms min=39.4µs med=92.7µs max=557.13ms p(90)=16.2ms p(95)=85.96ms http_req_sending...............: avg=822.55µs min=9.11µs med=17.48µs max=277.74ms p(90)=65.02µs p(95)=661.89µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=937.85ms min=412.78ms med=913.57ms max=2.11s p(90)=1.22s p(95)=1.34s http_reqs......................: 3069 99.64097/s iteration_duration.............: avg=995.44ms min=421.36ms med=967.16ms max=2.15s p(90)=1.31s p(95)=1.44s iterations.....................: 3069 99.64097/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7593 ✗ 0 data_received..................: 222 MB 7.2 MB/s data_sent......................: 3.0 MB 97 kB/s http_req_blocked...............: avg=153.68µs min=1.29µs med=2.52µs max=8.23ms p(90)=3.76µs p(95)=8.97µs http_req_connecting............: avg=145.42µs min=0s med=0s max=8.18ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.16s min=673.58ms med=1.15s max=1.8s p(90)=1.37s p(95)=1.47s { expected_response:true }...: avg=1.16s min=673.58ms med=1.15s max=1.8s p(90)=1.37s p(95)=1.47s http_req_failed................: 0.00% ✓ 0 ✗ 2531 http_req_receiving.............: avg=9.97ms min=38.02µs med=73.93µs max=305.02ms p(90)=23.69ms p(95)=78.68ms http_req_sending...............: avg=1.5ms min=7.64µs med=12.75µs max=159.91ms p(90)=58.45µs p(95)=800.43µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.15s min=673.49ms med=1.13s max=1.73s p(90)=1.36s p(95)=1.45s http_reqs......................: 2531 81.758134/s iteration_duration.............: avg=1.2s min=683.59ms med=1.19s max=1.84s p(90)=1.43s p(95)=1.54s iterations.....................: 2531 81.758134/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6033 ✗ 0 data_received..................: 177 MB 5.6 MB/s data_sent......................: 2.4 MB 76 kB/s http_req_blocked...............: avg=146.19µs min=1.59µs med=3.65µs max=9.85ms p(90)=5.33µs p(95)=120.67µs http_req_connecting............: avg=133.75µs min=0s med=0s max=9.16ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.52s min=787.25ms med=1.44s max=9.89s p(90)=1.66s p(95)=1.75s { expected_response:true }...: avg=1.52s min=787.25ms med=1.44s max=9.89s p(90)=1.66s p(95)=1.75s http_req_failed................: 0.00% ✓ 0 ✗ 2011 http_req_receiving.............: avg=163.12µs min=50.22µs med=116.86µs max=21.7ms p(90)=181.16µs p(95)=238.21µs http_req_sending...............: avg=46.12µs min=9.75µs med=19.3µs max=4.66ms p(90)=34.79µs p(95)=50.87µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.52s min=787.14ms med=1.44s max=9.89s p(90)=1.66s p(95)=1.75s http_reqs......................: 2011 64.175304/s iteration_duration.............: avg=1.53s min=797.9ms med=1.45s max=9.9s p(90)=1.67s p(95)=1.76s iterations.....................: 2011 64.175304/s vus............................: 59 min=59 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5709 ✗ 0 data_received..................: 167 MB 5.4 MB/s data_sent......................: 2.3 MB 73 kB/s http_req_blocked...............: avg=297.57µs min=1.72µs med=4.44µs max=12.42ms p(90)=6.19µs p(95)=2.37ms http_req_connecting............: avg=82.3µs min=0s med=0s max=8.06ms p(90)=0s p(95)=172.71µs http_req_duration..............: avg=1.58s min=538.87ms med=1.56s max=3.78s p(90)=2.08s p(95)=2.32s { expected_response:true }...: avg=1.58s min=538.87ms med=1.56s max=3.78s p(90)=2.08s p(95)=2.32s http_req_failed................: 0.00% ✓ 0 ✗ 1903 http_req_receiving.............: avg=1.27ms min=42.29µs med=133.46µs max=44.99ms p(90)=1.64ms p(95)=6.81ms http_req_sending...............: avg=178.24µs min=8.56µs med=24.46µs max=26.98ms p(90)=45.35µs p(95)=373.51µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.58s min=537.85ms med=1.56s max=3.78s p(90)=2.08s p(95)=2.32s http_reqs......................: 1903 61.584412/s iteration_duration.............: avg=1.6s min=550.68ms med=1.58s max=3.82s p(90)=2.1s p(95)=2.35s iterations.....................: 1903 61.584412/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1422 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 563 kB 15 kB/s http_req_blocked...............: avg=627.57µs min=1.78µs med=3.95µs max=6.78ms p(90)=2.23ms p(95)=4.68ms http_req_connecting............: avg=592.67µs min=0s med=0s max=6.68ms p(90)=2.2ms p(95)=4.34ms http_req_duration..............: avg=7.11s min=2.85s med=7.36s max=8.72s p(90)=8.29s p(95)=8.38s { expected_response:true }...: avg=7.11s min=2.85s med=7.36s max=8.72s p(90)=8.29s p(95)=8.38s http_req_failed................: 0.00% ✓ 0 ✗ 474 http_req_receiving.............: avg=219.82µs min=58.82µs med=125.54µs max=36.27ms p(90)=181.66µs p(95)=218.14µs http_req_sending...............: avg=79.88µs min=10.25µs med=20.99µs max=696.3µs p(90)=301.3µs p(95)=408.28µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.11s min=2.85s med=7.36s max=8.72s p(90)=8.29s p(95)=8.38s http_reqs......................: 474 12.717212/s iteration_duration.............: avg=7.12s min=2.86s med=7.37s max=8.73s p(90)=8.3s p(95)=8.39s iterations.....................: 474 12.717212/s vus............................: 7 min=7 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 147 4532 total, 0 failed avg: 618ms, p95: 808ms ✅
wundergraph 104 3230 total, 0 failed avg: 913ms, p95: 1112ms ✅
mesh-supergraph-bun 84 2625 total, 0 failed avg: 1146ms, p95: 1670ms ✅
cosmo 80 2515 total, 0 failed avg: 1192ms, p95: 1435ms ✅
apollo-server 48 1540 total, 0 failed avg: 1998ms, p95: 2261ms ✅
mesh-supergraph 28 906 total, 0 failed avg: 3449ms, p95: 5767ms ✅
mercurius 12 455 total, 0 failed avg: 7499ms, p95: 9088ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13596 ✗ 0 data_received..................: 398 MB 13 MB/s data_sent......................: 5.4 MB 176 kB/s http_req_blocked...............: avg=42.37µs min=1.55µs med=3.29µs max=74.22ms p(90)=5.12µs p(95)=6.66µs http_req_connecting............: avg=6.74µs min=0s med=0s max=952.57µs p(90)=0s p(95)=0s http_req_duration..............: avg=618.21ms min=300.79ms med=612.66ms max=1.19s p(90)=745.4ms p(95)=808.03ms { expected_response:true }...: avg=618.21ms min=300.79ms med=612.66ms max=1.19s p(90)=745.4ms p(95)=808.03ms http_req_failed................: 0.00% ✓ 0 ✗ 4532 http_req_receiving.............: avg=8.28ms min=36.42µs med=73.69µs max=384.54ms p(90)=10.64ms p(95)=62.17ms http_req_sending...............: avg=1.27ms min=9µs med=15.82µs max=328.21ms p(90)=41.84µs p(95)=175.56µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=608.65ms min=300.64ms med=606.83ms max=998.95ms p(90)=727.77ms p(95)=772.55ms http_reqs......................: 4532 147.817739/s iteration_duration.............: avg=670.63ms min=330.99ms med=658.91ms max=1.33s p(90)=823.34ms p(95)=898.4ms iterations.....................: 4532 147.817739/s vus............................: 99 min=99 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9690 ✗ 0 data_received..................: 283 MB 9.1 MB/s data_sent......................: 3.8 MB 124 kB/s http_req_blocked...............: avg=39.77µs min=1.24µs med=2.74µs max=7.34ms p(90)=4.19µs p(95)=7.79µs http_req_connecting............: avg=29.06µs min=0s med=0s max=5.19ms p(90)=0s p(95)=0s http_req_duration..............: avg=913.12ms min=555.46ms med=905.54ms max=1.5s p(90)=1.05s p(95)=1.11s { expected_response:true }...: avg=913.12ms min=555.46ms med=905.54ms max=1.5s p(90)=1.05s p(95)=1.11s http_req_failed................: 0.00% ✓ 0 ✗ 3230 http_req_receiving.............: avg=9.42ms min=38µs med=81.01µs max=251.14ms p(90)=35.51ms p(95)=70.66ms http_req_sending...............: avg=1.43ms min=7.65µs med=13µs max=256.08ms p(90)=51.82µs p(95)=653.2µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=902.26ms min=549.72ms med=898.29ms max=1.44s p(90)=1.03s p(95)=1.08s http_reqs......................: 3230 104.083493/s iteration_duration.............: avg=948.63ms min=564.76ms med=939.66ms max=1.53s p(90)=1.09s p(95)=1.17s iterations.....................: 3230 104.083493/s vus............................: 20 min=20 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7875 ✗ 0 data_received..................: 230 MB 7.4 MB/s data_sent......................: 3.1 MB 100 kB/s http_req_blocked...............: avg=293.35µs min=1.43µs med=2.94µs max=14.69ms p(90)=4.82µs p(95)=10.84µs http_req_connecting............: avg=77.05µs min=0s med=0s max=5.09ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.14s min=510.56ms med=1.1s max=2.26s p(90)=1.49s p(95)=1.66s { expected_response:true }...: avg=1.14s min=510.56ms med=1.1s max=2.26s p(90)=1.49s p(95)=1.66s http_req_failed................: 0.00% ✓ 0 ✗ 2625 http_req_receiving.............: avg=14.93ms min=39.4µs med=94.57µs max=639.56ms p(90)=3.91ms p(95)=64.39ms http_req_sending...............: avg=501.15µs min=8.12µs med=14.19µs max=112.89ms p(90)=48.95µs p(95)=239.93µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.13s min=510.27ms med=1.09s max=2.26s p(90)=1.45s p(95)=1.64s http_reqs......................: 2625 84.163338/s iteration_duration.............: avg=1.17s min=521.08ms med=1.13s max=2.28s p(90)=1.54s p(95)=1.71s iterations.....................: 2625 84.163338/s vus............................: 13 min=13 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7545 ✗ 0 data_received..................: 221 MB 7.1 MB/s data_sent......................: 3.0 MB 96 kB/s http_req_blocked...............: avg=105.97µs min=1.01µs med=2.61µs max=15.17ms p(90)=4.08µs p(95)=9.7µs http_req_connecting............: avg=33.82µs min=0s med=0s max=3.39ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.19s min=769.78ms med=1.18s max=1.71s p(90)=1.37s p(95)=1.43s { expected_response:true }...: avg=1.19s min=769.78ms med=1.18s max=1.71s p(90)=1.37s p(95)=1.43s http_req_failed................: 0.00% ✓ 0 ✗ 2515 http_req_receiving.............: avg=11.14ms min=37.79µs med=82.46µs max=269.02ms p(90)=31.17ms p(95)=86.56ms http_req_sending...............: avg=1.35ms min=8.19µs med=12.84µs max=230.11ms p(90)=76.41µs p(95)=989.22µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.17s min=769.58ms med=1.17s max=1.6s p(90)=1.35s p(95)=1.4s http_reqs......................: 2515 80.509296/s iteration_duration.............: avg=1.22s min=780.66ms med=1.21s max=1.73s p(90)=1.43s p(95)=1.49s iterations.....................: 2515 80.509296/s vus............................: 29 min=29 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4620 ✗ 0 data_received..................: 135 MB 4.3 MB/s data_sent......................: 1.8 MB 58 kB/s http_req_blocked...............: avg=116.26µs min=1.45µs med=3.4µs max=4.49ms p(90)=5.39µs p(95)=480.98µs http_req_connecting............: avg=107.96µs min=0s med=0s max=4.45ms p(90)=0s p(95)=455.13µs http_req_duration..............: avg=1.99s min=822.66ms med=1.79s max=13.86s p(90)=2.16s p(95)=2.26s { expected_response:true }...: avg=1.99s min=822.66ms med=1.79s max=13.86s p(90)=2.16s p(95)=2.26s http_req_failed................: 0.00% ✓ 0 ✗ 1540 http_req_receiving.............: avg=212.12µs min=50.13µs med=124.01µs max=34.99ms p(90)=185.65µs p(95)=234.4µs http_req_sending...............: avg=66.73µs min=8.61µs med=17.98µs max=49.9ms p(90)=34.1µs p(95)=142.83µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.99s min=822.48ms med=1.79s max=13.86s p(90)=2.16s p(95)=2.26s http_reqs......................: 1540 48.833877/s iteration_duration.............: avg=2s min=829.21ms med=1.8s max=13.88s p(90)=2.17s p(95)=2.27s iterations.....................: 1540 48.833877/s vus............................: 57 min=57 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2718 ✗ 0 data_received..................: 80 MB 2.5 MB/s data_sent......................: 1.1 MB 34 kB/s http_req_blocked...............: avg=84.87µs min=1.57µs med=4.13µs max=3.99ms p(90)=118.52µs p(95)=584.8µs http_req_connecting............: avg=68.52µs min=0s med=0s max=2.7ms p(90)=74.5µs p(95)=507.89µs http_req_duration..............: avg=3.44s min=1.48s med=3.11s max=7.96s p(90)=5.06s p(95)=5.76s { expected_response:true }...: avg=3.44s min=1.48s med=3.11s max=7.96s p(90)=5.06s p(95)=5.76s http_req_failed................: 0.00% ✓ 0 ✗ 906 http_req_receiving.............: avg=3.32ms min=44.48µs med=197.7µs max=304.02ms p(90)=1.78ms p(95)=10.78ms http_req_sending...............: avg=61.91µs min=8.87µs med=23.86µs max=5.71ms p(90)=92.17µs p(95)=253.54µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.44s min=1.48s med=3.11s max=7.95s p(90)=5.06s p(95)=5.76s http_reqs......................: 906 28.387127/s iteration_duration.............: avg=3.46s min=1.49s med=3.14s max=7.97s p(90)=5.07s p(95)=5.78s iterations.....................: 906 28.387127/s vus............................: 80 min=80 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1365 ✗ 0 data_received..................: 40 MB 1.1 MB/s data_sent......................: 540 kB 14 kB/s http_req_blocked...............: avg=258.86µs min=1.56µs med=3.56µs max=7.11ms p(90)=831.99µs p(95)=1.61ms http_req_connecting............: avg=229.49µs min=0s med=0s max=3.88ms p(90)=762.74µs p(95)=1.48ms http_req_duration..............: avg=7.49s min=3.16s med=7.72s max=9.43s p(90)=8.8s p(95)=9.08s { expected_response:true }...: avg=7.49s min=3.16s med=7.72s max=9.43s p(90)=8.8s p(95)=9.08s http_req_failed................: 0.00% ✓ 0 ✗ 455 http_req_receiving.............: avg=139.64µs min=58.14µs med=119.95µs max=1.68ms p(90)=189.35µs p(95)=222.65µs http_req_sending...............: avg=97.48µs min=9.62µs med=20.46µs max=3.17ms p(90)=393.7µs p(95)=522.48µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.49s min=3.16s med=7.72s max=9.43s p(90)=8.8s p(95)=9.08s http_reqs......................: 455 12.094083/s iteration_duration.............: avg=7.5s min=3.17s med=7.73s max=9.44s p(90)=8.8s p(95)=9.09s iterations.....................: 455 12.094083/s vus............................: 12 min=12 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2380ms 175 12293 total, 0 failed avg: 816ms, p95: 2381ms, max: 6521ms, med: 576ms ✅
apollo-router 2476ms 173 12151 total, 0 failed avg: 767ms, p95: 2476ms, max: 7619ms, med: 445ms ✅
wundergraph 2538ms 168 11775 total, 0 failed avg: 750ms, p95: 2538ms, max: 6377ms, med: 405ms ✅
mesh-supergraph-bun 5566ms 113 7969 total, 0 failed avg: 2301ms, p95: 5567ms, max: 9470ms, med: 2073ms ✅
mesh-supergraph 6482ms 69 4873 total, 0 failed avg: 3883ms, p95: 6482ms, max: 8676ms, med: 4009ms ✅
apollo-server 23706ms 68 4999 total, 0 failed avg: 4175ms, p95: 23707ms, max: 45031ms, med: 2223ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36879 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 208 kB/s http_req_blocked...............: avg=20.4ms min=1.3µs med=2.79µs max=3.76s p(90)=4.32µs p(95)=10.76µs http_req_connecting............: avg=19.88ms min=0s med=0s max=3.76s p(90)=0s p(95)=0s http_req_duration..............: avg=815.53ms min=6.64ms med=576.44ms max=6.52s p(90)=1.83s p(95)=2.38s { expected_response:true }...: avg=815.53ms min=6.64ms med=576.44ms max=6.52s p(90)=1.83s p(95)=2.38s http_req_failed................: 0.00% ✓ 0 ✗ 12293 http_req_receiving.............: avg=283.01ms min=35.23µs med=80.57µs max=6.29s p(90)=1.12s p(95)=1.68s http_req_sending...............: avg=30.25ms min=7.39µs med=13.46µs max=4.42s p(90)=173.75µs p(95)=56.61ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=502.26ms min=6.56ms med=389.18ms max=2.64s p(90)=1.1s p(95)=1.32s http_reqs......................: 12293 175.583971/s iteration_duration.............: avg=1.5s min=11.99ms med=1.03s max=12.23s p(90)=3.44s p(95)=4.56s iterations.....................: 12293 175.583971/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36453 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 206 kB/s http_req_blocked...............: avg=11.83ms min=1.55µs med=3.05µs max=5.58s p(90)=4.86µs p(95)=11.85µs http_req_connecting............: avg=11.16ms min=0s med=0s max=5.58s p(90)=0s p(95)=0s http_req_duration..............: avg=766.78ms min=6.37ms med=444.8ms max=7.61s p(90)=1.93s p(95)=2.47s { expected_response:true }...: avg=766.78ms min=6.37ms med=444.8ms max=7.61s p(90)=1.93s p(95)=2.47s http_req_failed................: 0.00% ✓ 0 ✗ 12151 http_req_receiving.............: avg=333.57ms min=29.48µs med=85.78µs max=7.2s p(90)=1.23s p(95)=1.87s http_req_sending...............: avg=41.65ms min=7.26µs med=14.01µs max=6.16s p(90)=454.58µs p(95)=66.02ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=391.55ms min=6.3ms med=326.55ms max=2.3s p(90)=758.03ms p(95)=905.87ms http_reqs......................: 12151 173.581552/s iteration_duration.............: avg=1.5s min=11.87ms med=869.34ms max=13.43s p(90)=3.69s p(95)=4.9s iterations.....................: 12151 173.581552/s vus............................: 1 min=1 max=496 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35325 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 200 kB/s http_req_blocked...............: avg=14.48ms min=1.5µs med=3.03µs max=4.48s p(90)=4.88µs p(95)=12.86µs http_req_connecting............: avg=13.63ms min=0s med=0s max=4.32s p(90)=0s p(95)=0s http_req_duration..............: avg=749.65ms min=7.28ms med=405.09ms max=6.37s p(90)=1.83s p(95)=2.53s { expected_response:true }...: avg=749.65ms min=7.28ms med=405.09ms max=6.37s p(90)=1.83s p(95)=2.53s http_req_failed................: 0.00% ✓ 0 ✗ 11775 http_req_receiving.............: avg=335.77ms min=33.58µs med=85.79µs max=5.91s p(90)=1.27s p(95)=1.86s http_req_sending...............: avg=35.02ms min=7.79µs med=13.83µs max=4.27s p(90)=138.85µs p(95)=47.58ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=378.85ms min=7.15ms med=273.45ms max=2.57s p(90)=821.72ms p(95)=1.07s http_reqs......................: 11775 168.206896/s iteration_duration.............: avg=1.56s min=12.85ms med=903.31ms max=11.24s p(90)=3.93s p(95)=4.94s iterations.....................: 11775 168.206896/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 23907 ✗ 0 data_received..................: 699 MB 10 MB/s data_sent......................: 9.5 MB 135 kB/s http_req_blocked...............: avg=2.06ms min=1.71µs med=3.46µs max=544.55ms p(90)=6.38µs p(95)=237.46µs http_req_connecting............: avg=2.03ms min=0s med=0s max=544.49ms p(90)=0s p(95)=162.51µs http_req_duration..............: avg=2.3s min=7.4ms med=2.07s max=9.46s p(90)=4s p(95)=5.56s { expected_response:true }...: avg=2.3s min=7.4ms med=2.07s max=9.46s p(90)=4s p(95)=5.56s http_req_failed................: 0.00% ✓ 0 ✗ 7969 http_req_receiving.............: avg=32.65ms min=35µs med=84.8µs max=1.44s p(90)=31.49ms p(95)=229.95ms http_req_sending...............: avg=2.37ms min=9.07µs med=16.73µs max=462.68ms p(90)=109.9µs p(95)=9.3ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.26s min=7.2ms med=2.04s max=9.46s p(90)=3.94s p(95)=5.55s http_reqs......................: 7969 113.820205/s iteration_duration.............: avg=2.36s min=13.67ms med=2.12s max=9.61s p(90)=4.13s p(95)=5.65s iterations.....................: 7969 113.820205/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14619 ✗ 0 data_received..................: 428 MB 6.1 MB/s data_sent......................: 5.8 MB 83 kB/s http_req_blocked...............: avg=723.18µs min=1.36µs med=3.86µs max=177.53ms p(90)=159.19µs p(95)=417.67µs http_req_connecting............: avg=685.66µs min=0s med=0s max=177.46ms p(90)=98.76µs p(95)=333.14µs http_req_duration..............: avg=3.88s min=11.53ms med=4s max=8.67s p(90)=6.07s p(95)=6.48s { expected_response:true }...: avg=3.88s min=11.53ms med=4s max=8.67s p(90)=6.07s p(95)=6.48s http_req_failed................: 0.00% ✓ 0 ✗ 4873 http_req_receiving.............: avg=2.11ms min=38.92µs med=103.19µs max=436.84ms p(90)=896.89µs p(95)=7.18ms http_req_sending...............: avg=707.51µs min=7.9µs med=20.18µs max=130.49ms p(90)=57.06µs p(95)=139.89µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.88s min=11.43ms med=4s max=8.6s p(90)=6.06s p(95)=6.48s http_reqs......................: 4873 69.607786/s iteration_duration.............: avg=3.91s min=17.64ms med=4.05s max=8.74s p(90)=6.13s p(95)=6.54s iterations.....................: 4873 69.607786/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14997 ✗ 0 data_received..................: 439 MB 6.0 MB/s data_sent......................: 5.9 MB 81 kB/s http_req_blocked...............: avg=90.83µs min=1.36µs med=3µs max=27.67ms p(90)=162.36µs p(95)=309.05µs http_req_connecting............: avg=78.09µs min=0s med=0s max=27.51ms p(90)=16.72µs p(95)=228.64µs http_req_duration..............: avg=4.17s min=83.84ms med=2.22s max=45.03s p(90)=3.37s p(95)=23.7s { expected_response:true }...: avg=4.17s min=83.84ms med=2.22s max=45.03s p(90)=3.37s p(95)=23.7s http_req_failed................: 0.00% ✓ 0 ✗ 4999 http_req_receiving.............: avg=213.12µs min=44.79µs med=113.66µs max=78.47ms p(90)=176.06µs p(95)=209.54µs http_req_sending...............: avg=56.4µs min=8.54µs med=15.14µs max=18.85ms p(90)=39.91µs p(95)=58.81µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.17s min=83.73ms med=2.22s max=45.03s p(90)=3.37s p(95)=23.7s http_reqs......................: 4999 68.33959/s iteration_duration.............: avg=4.18s min=91.96ms med=2.23s max=45.03s p(90)=3.39s p(95)=23.71s iterations.....................: 4999 68.33959/s vus............................: 16 min=16 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview