search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency @types/node to v20.11.29 - autoclosed #402

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@types/node (source) 20.11.28 -> 20.11.29 age adoption passing confidence

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 174 5317 total, 0 failed avg: 486ms, p95: 680ms ✅
apollo-router 166 5068 total, 0 failed avg: 550ms, p95: 703ms ✅
wundergraph 159 4865 total, 0 failed avg: 515ms, p95: 931ms ✅
mesh-supergraph-bun 98 3017 total, 0 failed avg: 972ms, p95: 1600ms ✅
apollo-server 47 1488 total, 0 failed avg: 2065ms, p95: 2738ms ✅
mesh-supergraph 31 1008 total, 0 failed avg: 3087ms, p95: 5087ms ✅
mercurius 30 940 total, 0 failed avg: 3223ms, p95: 4991ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15951 ✗ 0 data_received..................: 467 MB 15 MB/s data_sent......................: 6.3 MB 208 kB/s http_req_blocked...............: avg=46.5µs min=1.32µs med=2.7µs max=57.36ms p(90)=4.34µs p(95)=5.58µs http_req_connecting............: avg=22.69µs min=0s med=0s max=4.23ms p(90)=0s p(95)=0s http_req_duration..............: avg=485.96ms min=26.75ms med=488.04ms max=1.56s p(90)=599.71ms p(95)=680.19ms { expected_response:true }...: avg=485.96ms min=26.75ms med=488.04ms max=1.56s p(90)=599.71ms p(95)=680.19ms http_req_failed................: 0.00% ✓ 0 ✗ 5317 http_req_receiving.............: avg=32.13ms min=37.54µs med=75.91µs max=1.3s p(90)=65.14ms p(95)=236.1ms http_req_sending...............: avg=2.05ms min=7.27µs med=13.18µs max=810.66ms p(90)=32.83µs p(95)=445.45µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=451.76ms min=26.63ms med=475.68ms max=804.1ms p(90)=560.68ms p(95)=588.02ms http_reqs......................: 5317 174.872232/s iteration_duration.............: avg=568.76ms min=38.41ms med=529.07ms max=3.03s p(90)=791.44ms p(95)=979.93ms iterations.....................: 5317 174.872232/s vus............................: 95 min=95 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15204 ✗ 0 data_received..................: 445 MB 15 MB/s data_sent......................: 6.0 MB 197 kB/s http_req_blocked...............: avg=85.44µs min=1.25µs med=2.86µs max=115.78ms p(90)=4.4µs p(95)=5.57µs http_req_connecting............: avg=39.54µs min=0s med=0s max=5.11ms p(90)=0s p(95)=0s http_req_duration..............: avg=549.77ms min=226.97ms med=542.99ms max=1.16s p(90)=662.71ms p(95)=702.99ms { expected_response:true }...: avg=549.77ms min=226.97ms med=542.99ms max=1.16s p(90)=662.71ms p(95)=702.99ms http_req_failed................: 0.00% ✓ 0 ✗ 5068 http_req_receiving.............: avg=8.49ms min=37.18µs med=68.14µs max=508.17ms p(90)=7.98ms p(95)=57.06ms http_req_sending...............: avg=1.11ms min=7.83µs med=13.9µs max=624.3ms p(90)=44.27µs p(95)=249.55µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=540.17ms min=226.91ms med=535.77ms max=857.76ms p(90)=643.89ms p(95)=678.42ms http_reqs......................: 5068 166.276778/s iteration_duration.............: avg=597.24ms min=285.82ms med=581.2ms max=1.62s p(90)=731.71ms p(95)=794.78ms iterations.....................: 5068 166.276778/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14595 ✗ 0 data_received..................: 427 MB 14 MB/s data_sent......................: 5.8 MB 190 kB/s http_req_blocked...............: avg=51.83µs min=1.34µs med=2.77µs max=105.11ms p(90)=4.42µs p(95)=5.52µs http_req_connecting............: avg=33.96µs min=0s med=0s max=77.47ms p(90)=0s p(95)=0s http_req_duration..............: avg=514.54ms min=15.99ms med=485.35ms max=2.59s p(90)=813.22ms p(95)=930.95ms { expected_response:true }...: avg=514.54ms min=15.99ms med=485.35ms max=2.59s p(90)=813.22ms p(95)=930.95ms http_req_failed................: 0.00% ✓ 0 ✗ 4865 http_req_receiving.............: avg=47.28ms min=37.99µs med=80.81µs max=2.2s p(90)=128.37ms p(95)=323.48ms http_req_sending...............: avg=3.03ms min=7.88µs med=13.25µs max=904.68ms p(90)=38.1µs p(95)=446.99µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=464.22ms min=14.75ms med=443.8ms max=1.14s p(90)=737.4ms p(95)=827.39ms http_reqs......................: 4865 159.667753/s iteration_duration.............: avg=623.71ms min=34.83ms med=568.68ms max=3.52s p(90)=1s p(95)=1.19s iterations.....................: 4865 159.667753/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9051 ✗ 0 data_received..................: 265 MB 8.7 MB/s data_sent......................: 3.6 MB 117 kB/s http_req_blocked...............: avg=67.55µs min=1.28µs med=2.73µs max=62.7ms p(90)=4.29µs p(95)=9.15µs http_req_connecting............: avg=24.69µs min=0s med=0s max=3.24ms p(90)=0s p(95)=0s http_req_duration..............: avg=972.46ms min=415.57ms med=824.58ms max=3.61s p(90)=1.51s p(95)=1.59s { expected_response:true }...: avg=972.46ms min=415.57ms med=824.58ms max=3.61s p(90)=1.51s p(95)=1.59s http_req_failed................: 0.00% ✓ 0 ✗ 3017 http_req_receiving.............: avg=10.55ms min=39.15µs med=88.53µs max=654.35ms p(90)=4.76ms p(95)=59.32ms http_req_sending...............: avg=435.76µs min=7.7µs med=13.5µs max=72.93ms p(90)=32.8µs p(95)=139.23µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=961.48ms min=415.51ms med=816.59ms max=3.61s p(90)=1.5s p(95)=1.58s http_reqs......................: 3017 98.934792/s iteration_duration.............: avg=1s min=430.23ms med=856.88ms max=3.64s p(90)=1.54s p(95)=1.62s iterations.....................: 3017 98.934792/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4464 ✗ 0 data_received..................: 131 MB 4.2 MB/s data_sent......................: 1.8 MB 56 kB/s http_req_blocked...............: avg=105.6µs min=1.47µs med=4.1µs max=7.67ms p(90)=6.28µs p(95)=291.5µs http_req_connecting............: avg=81.88µs min=0s med=0s max=7.64ms p(90)=0s p(95)=204.64µs http_req_duration..............: avg=2.06s min=442.58ms med=1.7s max=22.36s p(90)=2.1s p(95)=2.73s { expected_response:true }...: avg=2.06s min=442.58ms med=1.7s max=22.36s p(90)=2.1s p(95)=2.73s http_req_failed................: 0.00% ✓ 0 ✗ 1488 http_req_receiving.............: avg=175.24µs min=56.73µs med=135.18µs max=40.05ms p(90)=193.03µs p(95)=220.64µs http_req_sending...............: avg=89.34µs min=8.86µs med=23.08µs max=5.64ms p(90)=40.6µs p(95)=162.92µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.06s min=442.23ms med=1.7s max=22.35s p(90)=2.1s p(95)=2.73s http_reqs......................: 1488 47.319342/s iteration_duration.............: avg=2.07s min=449.32ms med=1.71s max=22.37s p(90)=2.11s p(95)=2.74s iterations.....................: 1488 47.319342/s vus............................: 56 min=56 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 3024 ✗ 0 data_received..................: 88 MB 2.8 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=272.62µs min=1.31µs med=3.37µs max=6.32ms p(90)=31.23µs p(95)=2.11ms http_req_connecting............: avg=258.84µs min=0s med=0s max=6.27ms p(90)=0s p(95)=2.08ms http_req_duration..............: avg=3.08s min=1.58s med=2.88s max=6.26s p(90)=3.98s p(95)=5.08s { expected_response:true }...: avg=3.08s min=1.58s med=2.88s max=6.26s p(90)=3.98s p(95)=5.08s http_req_failed................: 0.00% ✓ 0 ✗ 1008 http_req_receiving.............: avg=3.54ms min=38.46µs med=152.23µs max=675.72ms p(90)=1.99ms p(95)=9.29ms http_req_sending...............: avg=76.22µs min=8.11µs med=17.61µs max=12.35ms p(90)=118.37µs p(95)=251.83µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.08s min=1.58s med=2.88s max=6.26s p(90)=3.98s p(95)=5.08s http_reqs......................: 1008 31.428989/s iteration_duration.............: avg=3.1s min=1.59s med=2.9s max=6.28s p(90)=3.99s p(95)=5.11s iterations.....................: 1008 31.428989/s vus............................: 7 min=7 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2820 ✗ 0 data_received..................: 83 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=119.31µs min=1.63µs med=4.08µs max=3.69ms p(90)=155.12µs p(95)=852.34µs http_req_connecting............: avg=95.45µs min=0s med=0s max=3.46ms p(90)=107.7µs p(95)=741.72µs http_req_duration..............: avg=3.22s min=436.76ms med=2.99s max=8.34s p(90)=4.28s p(95)=4.99s { expected_response:true }...: avg=3.22s min=436.76ms med=2.99s max=8.34s p(90)=4.28s p(95)=4.99s http_req_failed................: 0.00% ✓ 0 ✗ 940 http_req_receiving.............: avg=343.4µs min=46.48µs med=122.72µs max=81.72ms p(90)=187.88µs p(95)=230.64µs http_req_sending...............: avg=65.85µs min=9.06µs med=24.21µs max=5.99ms p(90)=52.83µs p(95)=182.49µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.22s min=436.5ms med=2.99s max=8.34s p(90)=4.28s p(95)=4.99s http_reqs......................: 940 30.661024/s iteration_duration.............: avg=3.23s min=446.38ms med=3s max=8.35s p(90)=4.29s p(95)=5s iterations.....................: 940 30.661024/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2378ms 173 12171 total, 0 failed avg: 762ms, p95: 2379ms, max: 6964ms, med: 497ms ✅
apollo-router 2520ms 176 12361 total, 0 failed avg: 838ms, p95: 2521ms, max: 7117ms, med: 527ms ✅
wundergraph 2839ms 166 11629 total, 0 failed avg: 901ms, p95: 2839ms, max: 8119ms, med: 596ms ✅
mesh-supergraph-bun 5747ms 113 7927 total, 0 failed avg: 2327ms, p95: 5747ms, max: 9488ms, med: 2169ms ✅
mesh-supergraph 7175ms 67 4716 total, 0 failed avg: 4054ms, p95: 7176ms, max: 9184ms, med: 4140ms ✅
apollo-server 23605ms 69 5056 total, 0 failed avg: 4124ms, p95: 23606ms, max: 44858ms, med: 2167ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36513 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 206 kB/s http_req_blocked...............: avg=19.77ms min=1.45µs med=2.84µs max=4.03s p(90)=4.48µs p(95)=11.64µs http_req_connecting............: avg=18.22ms min=0s med=0s max=4.03s p(90)=0s p(95)=0s http_req_duration..............: avg=762.27ms min=6.53ms med=496.71ms max=6.96s p(90)=1.77s p(95)=2.37s { expected_response:true }...: avg=762.27ms min=6.53ms med=496.71ms max=6.96s p(90)=1.77s p(95)=2.37s http_req_failed................: 0.00% ✓ 0 ✗ 12171 http_req_receiving.............: avg=285.25ms min=32.55µs med=77.81µs max=5.77s p(90)=1.14s p(95)=1.73s http_req_sending...............: avg=30.72ms min=7.39µs med=13.61µs max=5.75s p(90)=176.46µs p(95)=65.22ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=446.3ms min=6.44ms med=349.27ms max=2.58s p(90)=960.33ms p(95)=1.17s http_reqs......................: 12171 173.842628/s iteration_duration.............: avg=1.5s min=11.88ms med=987.47ms max=14.3s p(90)=3.53s p(95)=4.65s iterations.....................: 12171 173.842628/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 37083 ✗ 0 data_received..................: 1.1 GB 16 MB/s data_sent......................: 15 MB 210 kB/s http_req_blocked...............: avg=19.95ms min=1.55µs med=2.97µs max=6.7s p(90)=4.84µs p(95)=11.72µs http_req_connecting............: avg=19.74ms min=0s med=0s max=6.7s p(90)=0s p(95)=0s http_req_duration..............: avg=838.09ms min=6.53ms med=527.24ms max=7.11s p(90)=1.97s p(95)=2.52s { expected_response:true }...: avg=838.09ms min=6.53ms med=527.24ms max=7.11s p(90)=1.97s p(95)=2.52s http_req_failed................: 0.00% ✓ 0 ✗ 12361 http_req_receiving.............: avg=308.65ms min=30.82µs med=78.29µs max=6.23s p(90)=1.2s p(95)=1.77s http_req_sending...............: avg=35.24ms min=7.9µs med=14.06µs max=3.93s p(90)=419.81µs p(95)=75.02ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=494.18ms min=6.47ms med=401.22ms max=2.68s p(90)=1.02s p(95)=1.25s http_reqs......................: 12361 176.577406/s iteration_duration.............: avg=1.5s min=11.95ms med=953.43ms max=11.28s p(90)=3.61s p(95)=4.71s iterations.....................: 12361 176.577406/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34887 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 197 kB/s http_req_blocked...............: avg=25.51ms min=1.54µs med=3.06µs max=4.05s p(90)=4.69µs p(95)=13.32µs http_req_connecting............: avg=23.47ms min=0s med=0s max=4.05s p(90)=0s p(95)=0s http_req_duration..............: avg=901.04ms min=6.07ms med=596.37ms max=8.11s p(90)=2.13s p(95)=2.83s { expected_response:true }...: avg=901.04ms min=6.07ms med=596.37ms max=8.11s p(90)=2.13s p(95)=2.83s http_req_failed................: 0.00% ✓ 0 ✗ 11629 http_req_receiving.............: avg=354.8ms min=34.71µs med=80.92µs max=6.79s p(90)=1.38s p(95)=2.23s http_req_sending...............: avg=49.72ms min=7.64µs med=14.02µs max=6.53s p(90)=4.65ms p(95)=138.41ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=496.52ms min=5.98ms med=370.57ms max=3.57s p(90)=1.07s p(95)=1.31s http_reqs......................: 11629 166.095609/s iteration_duration.............: avg=1.59s min=11.47ms med=1.05s max=14.37s p(90)=3.79s p(95)=4.67s iterations.....................: 11629 166.095609/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 23781 ✗ 0 data_received..................: 695 MB 9.9 MB/s data_sent......................: 9.4 MB 134 kB/s http_req_blocked...............: avg=1.97ms min=1.39µs med=3.2µs max=509.66ms p(90)=5.99µs p(95)=233.3µs http_req_connecting............: avg=1.87ms min=0s med=0s max=509.6ms p(90)=0s p(95)=157.41µs http_req_duration..............: avg=2.32s min=6.27ms med=2.16s max=9.48s p(90)=4.53s p(95)=5.74s { expected_response:true }...: avg=2.32s min=6.27ms med=2.16s max=9.48s p(90)=4.53s p(95)=5.74s http_req_failed................: 0.00% ✓ 0 ✗ 7927 http_req_receiving.............: avg=23.97ms min=32.09µs med=83.75µs max=1.44s p(90)=10.75ms p(95)=169.35ms http_req_sending...............: avg=2.91ms min=7.79µs med=14.88µs max=622.06ms p(90)=77.32µs p(95)=7.47ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.3s min=6.08ms med=2.14s max=9.04s p(90)=4.52s p(95)=5.74s http_reqs......................: 7927 113.234999/s iteration_duration.............: avg=2.39s min=12.6ms med=2.2s max=9.55s p(90)=4.62s p(95)=5.86s iterations.....................: 7927 113.234999/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14148 ✗ 0 data_received..................: 414 MB 5.9 MB/s data_sent......................: 5.6 MB 80 kB/s http_req_blocked...............: avg=571.53µs min=1.42µs med=3.95µs max=217.74ms p(90)=179.71µs p(95)=454.85µs http_req_connecting............: avg=555.1µs min=0s med=0s max=217.55ms p(90)=118.92µs p(95)=376.34µs http_req_duration..............: avg=4.05s min=11.33ms med=4.13s max=9.18s p(90)=6.6s p(95)=7.17s { expected_response:true }...: avg=4.05s min=11.33ms med=4.13s max=9.18s p(90)=6.6s p(95)=7.17s http_req_failed................: 0.00% ✓ 0 ✗ 4716 http_req_receiving.............: avg=3.63ms min=39.41µs med=104.6µs max=575.6ms p(90)=1.25ms p(95)=9.43ms http_req_sending...............: avg=409.44µs min=7.62µs med=21.08µs max=153.84ms p(90)=54.32µs p(95)=140.43µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.05s min=11.25ms med=4.13s max=9.18s p(90)=6.6s p(95)=7.16s http_reqs......................: 4716 67.356977/s iteration_duration.............: avg=4.09s min=17.09ms med=4.16s max=9.28s p(90)=6.66s p(95)=7.21s iterations.....................: 4716 67.356977/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15168 ✗ 0 data_received..................: 444 MB 6.1 MB/s data_sent......................: 6.0 MB 82 kB/s http_req_blocked...............: avg=77.28µs min=1.45µs med=3.11µs max=35.11ms p(90)=33.95µs p(95)=315.11µs http_req_connecting............: avg=65.76µs min=0s med=0s max=35.04ms p(90)=0s p(95)=231.48µs http_req_duration..............: avg=4.12s min=80.36ms med=2.16s max=44.85s p(90)=3.44s p(95)=23.6s { expected_response:true }...: avg=4.12s min=80.36ms med=2.16s max=44.85s p(90)=3.44s p(95)=23.6s http_req_failed................: 0.00% ✓ 0 ✗ 5056 http_req_receiving.............: avg=240.41µs min=41.92µs med=117.96µs max=166.38ms p(90)=180.9µs p(95)=214.55µs http_req_sending...............: avg=41.93µs min=8.33µs med=15.89µs max=21.48ms p(90)=38.73µs p(95)=57.17µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.12s min=80.23ms med=2.16s max=44.85s p(90)=3.44s p(95)=23.6s http_reqs......................: 5056 69.103844/s iteration_duration.............: avg=4.13s min=92.54ms med=2.17s max=44.86s p(90)=3.45s p(95)=23.61s iterations.....................: 5056 69.103844/s vus............................: 19 min=19 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 162 4973 total, 0 failed avg: 541ms, p95: 723ms ✅
wundergraph 105 3262 total, 0 failed avg: 898ms, p95: 1089ms ✅
mesh-supergraph-bun 93 2910 total, 0 failed avg: 1013ms, p95: 1458ms ✅
cosmo 81 2478 total, 0 failed avg: 1182ms, p95: 1443ms ✅
mesh-supergraph 67 2089 total, 0 failed avg: 1443ms, p95: 2153ms ✅
apollo-server 65 2033 total, 0 failed avg: 1498ms, p95: 1713ms ✅
mercurius 12 476 total, 0 failed avg: 7165ms, p95: 8613ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14919 ✗ 0 data_received..................: 436 MB 14 MB/s data_sent......................: 5.9 MB 193 kB/s http_req_blocked...............: avg=16.28µs min=1.57µs med=3.22µs max=12.3ms p(90)=5.08µs p(95)=6.21µs http_req_connecting............: avg=7.58µs min=0s med=0s max=1.39ms p(90)=0s p(95)=0s http_req_duration..............: avg=540.98ms min=257.38ms med=529.43ms max=1.08s p(90)=667.05ms p(95)=723.21ms { expected_response:true }...: avg=540.98ms min=257.38ms med=529.43ms max=1.08s p(90)=667.05ms p(95)=723.21ms http_req_failed................: 0.00% ✓ 0 ✗ 4973 http_req_receiving.............: avg=16.39ms min=38.36µs med=82.57µs max=420.58ms p(90)=65.21ms p(95)=110.12ms http_req_sending...............: avg=1.6ms min=7.89µs med=15.24µs max=427.54ms p(90)=41.62µs p(95)=259.31µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=522.98ms min=257.28ms med=515.77ms max=924.24ms p(90)=643.66ms p(95)=678.32ms http_reqs......................: 4973 162.918087/s iteration_duration.............: avg=609.92ms min=288.45ms med=592.55ms max=1.28s p(90)=779.83ms p(95)=852.86ms iterations.....................: 4973 162.918087/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9786 ✗ 0 data_received..................: 286 MB 9.2 MB/s data_sent......................: 3.9 MB 125 kB/s http_req_blocked...............: avg=46.05µs min=1.32µs med=2.63µs max=12.02ms p(90)=4.16µs p(95)=8.69µs http_req_connecting............: avg=28.75µs min=0s med=0s max=3.55ms p(90)=0s p(95)=0s http_req_duration..............: avg=897.87ms min=564.53ms med=896.29ms max=1.32s p(90)=1.03s p(95)=1.08s { expected_response:true }...: avg=897.87ms min=564.53ms med=896.29ms max=1.32s p(90)=1.03s p(95)=1.08s http_req_failed................: 0.00% ✓ 0 ✗ 3262 http_req_receiving.............: avg=8.57ms min=39.93µs med=79.73µs max=291.89ms p(90)=25.38ms p(95)=58.62ms http_req_sending...............: avg=1.24ms min=7.62µs med=12.92µs max=297.33ms p(90)=37.98µs p(95)=309.37µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=888.04ms min=564.47ms med=888.26ms max=1.23s p(90)=1.03s p(95)=1.05s http_reqs......................: 3262 105.155348/s iteration_duration.............: avg=933.89ms min=573.82ms med=929.47ms max=1.35s p(90)=1.08s p(95)=1.13s iterations.....................: 3262 105.155348/s vus............................: 12 min=12 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8730 ✗ 0 data_received..................: 255 MB 8.2 MB/s data_sent......................: 3.5 MB 111 kB/s http_req_blocked...............: avg=83.62µs min=1.85µs med=4.28µs max=5.15ms p(90)=6.49µs p(95)=12.79µs http_req_connecting............: avg=73.36µs min=0s med=0s max=5.06ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.01s min=392.65ms med=985.36ms max=2.07s p(90)=1.34s p(95)=1.45s { expected_response:true }...: avg=1.01s min=392.65ms med=985.36ms max=2.07s p(90)=1.34s p(95)=1.45s http_req_failed................: 0.00% ✓ 0 ✗ 2910 http_req_receiving.............: avg=14.65ms min=39.18µs med=109.54µs max=893.75ms p(90)=8.87ms p(95)=94.35ms http_req_sending...............: avg=748.88µs min=9.83µs med=22.97µs max=180.8ms p(90)=58.47µs p(95)=254.4µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=997.34ms min=392.41ms med=971.9ms max=1.96s p(90)=1.31s p(95)=1.41s http_reqs......................: 2910 93.88743/s iteration_duration.............: avg=1.05s min=400.87ms med=1.02s max=2.1s p(90)=1.4s p(95)=1.51s iterations.....................: 2910 93.88743/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7434 ✗ 0 data_received..................: 217 MB 7.1 MB/s data_sent......................: 2.9 MB 97 kB/s http_req_blocked...............: avg=51.65µs min=1.63µs med=2.72µs max=61.57ms p(90)=4.59µs p(95)=9.99µs http_req_connecting............: avg=21.24µs min=0s med=0s max=2.21ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.18s min=751.37ms med=1.17s max=1.82s p(90)=1.36s p(95)=1.44s { expected_response:true }...: avg=1.18s min=751.37ms med=1.17s max=1.82s p(90)=1.36s p(95)=1.44s http_req_failed................: 0.00% ✓ 0 ✗ 2478 http_req_receiving.............: avg=17.06ms min=40.23µs med=86.33µs max=436.76ms p(90)=54.04ms p(95)=127.78ms http_req_sending...............: avg=1.74ms min=7.77µs med=13.22µs max=467.73ms p(90)=68.2µs p(95)=806.2µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.16s min=751.28ms med=1.16s max=1.58s p(90)=1.34s p(95)=1.39s http_reqs......................: 2478 81.333613/s iteration_duration.............: avg=1.22s min=760.86ms med=1.21s max=1.84s p(90)=1.42s p(95)=1.51s iterations.....................: 2478 81.333613/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6267 ✗ 0 data_received..................: 183 MB 5.9 MB/s data_sent......................: 2.5 MB 80 kB/s http_req_blocked...............: avg=130.29µs min=1.44µs med=3.56µs max=7.78ms p(90)=5.34µs p(95)=18.72µs http_req_connecting............: avg=116.16µs min=0s med=0s max=4.36ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.44s min=529.26ms med=1.43s max=3.68s p(90)=1.88s p(95)=2.15s { expected_response:true }...: avg=1.44s min=529.26ms med=1.43s max=3.68s p(90)=1.88s p(95)=2.15s http_req_failed................: 0.00% ✓ 0 ✗ 2089 http_req_receiving.............: avg=1.75ms min=37.81µs med=116.68µs max=106.8ms p(90)=1.89ms p(95)=8.17ms http_req_sending...............: avg=94.2µs min=8µs med=18.46µs max=33.42ms p(90)=37.05µs p(95)=138.1µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.44s min=529.2ms med=1.43s max=3.68s p(90)=1.88s p(95)=2.15s http_reqs......................: 2089 67.244405/s iteration_duration.............: avg=1.46s min=538.95ms med=1.44s max=3.69s p(90)=1.91s p(95)=2.19s iterations.....................: 2089 67.244405/s vus............................: 7 min=7 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6099 ✗ 0 data_received..................: 179 MB 5.7 MB/s data_sent......................: 2.4 MB 77 kB/s http_req_blocked...............: avg=78.89µs min=1.69µs med=3.24µs max=4.56ms p(90)=4.73µs p(95)=43.59µs http_req_connecting............: avg=70.45µs min=0s med=0s max=4.52ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.49s min=827.65ms med=1.44s max=8.78s p(90)=1.64s p(95)=1.71s { expected_response:true }...: avg=1.49s min=827.65ms med=1.44s max=8.78s p(90)=1.64s p(95)=1.71s http_req_failed................: 0.00% ✓ 0 ✗ 2033 http_req_receiving.............: avg=314.75µs min=44.42µs med=113.61µs max=69.92ms p(90)=188.9µs p(95)=267.94µs http_req_sending...............: avg=54.5µs min=8.98µs med=16.1µs max=17.18ms p(90)=31.23µs p(95)=46.13µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.49s min=827.18ms med=1.44s max=8.78s p(90)=1.64s p(95)=1.71s http_reqs......................: 2033 65.222703/s iteration_duration.............: avg=1.51s min=837.62ms med=1.45s max=8.79s p(90)=1.65s p(95)=1.73s iterations.....................: 2033 65.222703/s vus............................: 36 min=36 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1428 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 565 kB 15 kB/s http_req_blocked...............: avg=238.58µs min=1.54µs med=3.68µs max=7.61ms p(90)=773.91µs p(95)=1.52ms http_req_connecting............: avg=176.57µs min=0s med=0s max=2.85ms p(90)=643.39µs p(95)=1.33ms http_req_duration..............: avg=7.16s min=2.76s med=7.47s max=8.97s p(90)=8.32s p(95)=8.61s { expected_response:true }...: avg=7.16s min=2.76s med=7.47s max=8.97s p(90)=8.32s p(95)=8.61s http_req_failed................: 0.00% ✓ 0 ✗ 476 http_req_receiving.............: avg=129.23µs min=61.18µs med=115.68µs max=1.05ms p(90)=163.22µs p(95)=192.18µs http_req_sending...............: avg=92.94µs min=8.98µs med=20.68µs max=791.82µs p(90)=430.31µs p(95)=614.79µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.16s min=2.76s med=7.47s max=8.97s p(90)=8.32s p(95)=8.61s http_reqs......................: 476 12.654386/s iteration_duration.............: avg=7.17s min=2.76s med=7.47s max=8.97s p(90)=8.33s p(95)=8.62s iterations.....................: 476 12.654386/s vus............................: 13 min=13 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 147 4520 total, 0 failed avg: 623ms, p95: 804ms ✅
wundergraph 102 3164 total, 0 failed avg: 928ms, p95: 1149ms ✅
mesh-supergraph-bun 83 2575 total, 0 failed avg: 1151ms, p95: 1697ms ✅
cosmo 76 2412 total, 0 failed avg: 1218ms, p95: 1473ms ✅
apollo-server 46 1464 total, 0 failed avg: 2074ms, p95: 2399ms ✅
mesh-supergraph 30 983 total, 0 failed avg: 3202ms, p95: 5364ms ✅
mercurius 11 449 total, 0 failed avg: 7588ms, p95: 9063ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13560 ✗ 0 data_received..................: 397 MB 13 MB/s data_sent......................: 5.4 MB 175 kB/s http_req_blocked...............: avg=40.96µs min=1.32µs med=2.87µs max=7.03ms p(90)=4.35µs p(95)=5.59µs http_req_connecting............: avg=29.06µs min=0s med=0s max=5.03ms p(90)=0s p(95)=0s http_req_duration..............: avg=623.22ms min=285.32ms med=618.62ms max=1.14s p(90)=752.25ms p(95)=804.17ms { expected_response:true }...: avg=623.22ms min=285.32ms med=618.62ms max=1.14s p(90)=752.25ms p(95)=804.17ms http_req_failed................: 0.00% ✓ 0 ✗ 4520 http_req_receiving.............: avg=8.82ms min=37.71µs med=73.75µs max=327.5ms p(90)=24.59ms p(95)=62.7ms http_req_sending...............: avg=1.04ms min=7.85µs med=13.33µs max=226.23ms p(90)=35.24µs p(95)=280.78µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=613.35ms min=285.25ms med=610.94ms max=1.03s p(90)=733.72ms p(95)=781ms http_reqs......................: 4520 147.707428/s iteration_duration.............: avg=671.12ms min=305.91ms med=659.74ms max=1.27s p(90)=831.02ms p(95)=889.22ms iterations.....................: 4520 147.707428/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9492 ✗ 0 data_received..................: 278 MB 9.0 MB/s data_sent......................: 3.8 MB 121 kB/s http_req_blocked...............: avg=119.74µs min=1.29µs med=2.89µs max=87.62ms p(90)=4.85µs p(95)=9.39µs http_req_connecting............: avg=85.01µs min=0s med=0s max=6.54ms p(90)=0s p(95)=0s http_req_duration..............: avg=927.72ms min=527.49ms med=913.74ms max=1.75s p(90)=1.07s p(95)=1.14s { expected_response:true }...: avg=927.72ms min=527.49ms med=913.74ms max=1.75s p(90)=1.07s p(95)=1.14s http_req_failed................: 0.00% ✓ 0 ✗ 3164 http_req_receiving.............: avg=17.1ms min=35.7µs med=112.85µs max=494.15ms p(90)=60.73ms p(95)=96.82ms http_req_sending...............: avg=1.32ms min=8.53µs med=13.75µs max=225.93ms p(90)=46.38µs p(95)=300.62µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=909.29ms min=527.4ms med=901.98ms max=1.37s p(90)=1.05s p(95)=1.11s http_reqs......................: 3164 102.076763/s iteration_duration.............: avg=967.48ms min=542.32ms med=947.73ms max=1.77s p(90)=1.13s p(95)=1.21s iterations.....................: 3164 102.076763/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7725 ✗ 0 data_received..................: 226 MB 7.3 MB/s data_sent......................: 3.1 MB 99 kB/s http_req_blocked...............: avg=124.71µs min=1.43µs med=3.02µs max=40.97ms p(90)=4.92µs p(95)=10.33µs http_req_connecting............: avg=100.79µs min=0s med=0s max=6.03ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.15s min=544.45ms med=1.11s max=2.42s p(90)=1.5s p(95)=1.69s { expected_response:true }...: avg=1.15s min=544.45ms med=1.11s max=2.42s p(90)=1.5s p(95)=1.69s http_req_failed................: 0.00% ✓ 0 ✗ 2575 http_req_receiving.............: avg=14.21ms min=33.85µs med=98.5µs max=597.84ms p(90)=1.88ms p(95)=55.23ms http_req_sending...............: avg=451.06µs min=8.21µs med=14.33µs max=62.4ms p(90)=51.49µs p(95)=162.95µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.13s min=544.15ms med=1.09s max=2.42s p(90)=1.47s p(95)=1.67s http_reqs......................: 2575 83.310564/s iteration_duration.............: avg=1.17s min=553.29ms med=1.14s max=2.44s p(90)=1.53s p(95)=1.74s iterations.....................: 2575 83.310564/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7236 ✗ 0 data_received..................: 212 MB 6.7 MB/s data_sent......................: 2.9 MB 91 kB/s http_req_blocked...............: avg=69.75µs min=1.33µs med=2.65µs max=29.38ms p(90)=4.22µs p(95)=10.3µs http_req_connecting............: avg=50.95µs min=0s med=0s max=3.85ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.21s min=778.39ms med=1.2s max=1.72s p(90)=1.41s p(95)=1.47s { expected_response:true }...: avg=1.21s min=778.39ms med=1.2s max=1.72s p(90)=1.41s p(95)=1.47s http_req_failed................: 0.00% ✓ 0 ✗ 2412 http_req_receiving.............: avg=11.16ms min=40.81µs med=80.39µs max=390.66ms p(90)=30.52ms p(95)=63.15ms http_req_sending...............: avg=1.12ms min=8.21µs med=13.05µs max=197.21ms p(90)=49.72µs p(95)=731.44µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.2s min=778.25ms med=1.2s max=1.62s p(90)=1.36s p(95)=1.43s http_reqs......................: 2412 76.931657/s iteration_duration.............: avg=1.25s min=799.57ms med=1.23s max=1.76s p(90)=1.45s p(95)=1.5s iterations.....................: 2412 76.931657/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4392 ✗ 0 data_received..................: 129 MB 4.1 MB/s data_sent......................: 1.7 MB 56 kB/s http_req_blocked...............: avg=196.67µs min=1.57µs med=3.6µs max=6.79ms p(90)=5.83µs p(95)=1.26ms http_req_connecting............: avg=175.11µs min=0s med=0s max=6.73ms p(90)=0s p(95)=1.21ms http_req_duration..............: avg=2.07s min=944.38ms med=1.85s max=14.73s p(90)=2.24s p(95)=2.39s { expected_response:true }...: avg=2.07s min=944.38ms med=1.85s max=14.73s p(90)=2.24s p(95)=2.39s http_req_failed................: 0.00% ✓ 0 ✗ 1464 http_req_receiving.............: avg=336.23µs min=45.82µs med=119.38µs max=49.43ms p(90)=193.46µs p(95)=267.21µs http_req_sending...............: avg=69.85µs min=9.09µs med=18.37µs max=32.28ms p(90)=37.77µs p(95)=226.19µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.07s min=944.22ms med=1.85s max=14.73s p(90)=2.24s p(95)=2.39s http_reqs......................: 1464 46.885758/s iteration_duration.............: avg=2.08s min=954.55ms med=1.86s max=14.74s p(90)=2.25s p(95)=2.41s iterations.....................: 1464 46.885758/s vus............................: 3 min=3 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2949 ✗ 0 data_received..................: 86 MB 2.7 MB/s data_sent......................: 1.2 MB 36 kB/s http_req_blocked...............: avg=277.31µs min=1.45µs med=3.35µs max=9.09ms p(90)=204.07µs p(95)=2.26ms http_req_connecting............: avg=256.7µs min=0s med=0s max=5.83ms p(90)=129.96µs p(95)=2.17ms http_req_duration..............: avg=3.2s min=1.77s med=3.07s max=6.96s p(90)=4.2s p(95)=5.36s { expected_response:true }...: avg=3.2s min=1.77s med=3.07s max=6.96s p(90)=4.2s p(95)=5.36s http_req_failed................: 0.00% ✓ 0 ✗ 983 http_req_receiving.............: avg=3.62ms min=40.53µs med=158.61µs max=100.87ms p(90)=1.89ms p(95)=17.06ms http_req_sending...............: avg=115.69µs min=8.1µs med=18.65µs max=27.04ms p(90)=109.5µs p(95)=353.07µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.19s min=1.71s med=3.07s max=6.95s p(90)=4.2s p(95)=5.36s http_reqs......................: 983 30.519346/s iteration_duration.............: avg=3.21s min=1.79s med=3.09s max=6.97s p(90)=4.23s p(95)=5.37s iterations.....................: 983 30.519346/s vus............................: 32 min=32 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1347 ✗ 0 data_received..................: 39 MB 1.1 MB/s data_sent......................: 533 kB 14 kB/s http_req_blocked...............: avg=181.28µs min=1.63µs med=3.29µs max=2.69ms p(90)=475.68µs p(95)=1.44ms http_req_connecting............: avg=163.46µs min=0s med=0s max=2.66ms p(90)=325.77µs p(95)=1.4ms http_req_duration..............: avg=7.58s min=2.98s med=7.75s max=9.46s p(90)=8.87s p(95)=9.06s { expected_response:true }...: avg=7.58s min=2.98s med=7.75s max=9.46s p(90)=8.87s p(95)=9.06s http_req_failed................: 0.00% ✓ 0 ✗ 449 http_req_receiving.............: avg=132.94µs min=54.32µs med=119.28µs max=1.53ms p(90)=181.66µs p(95)=225.49µs http_req_sending...............: avg=118.14µs min=8.65µs med=19.43µs max=2.69ms p(90)=720.79µs p(95)=847.35µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.58s min=2.98s med=7.75s max=9.46s p(90)=8.87s p(95)=9.06s http_reqs......................: 449 11.963917/s iteration_duration.............: avg=7.59s min=3s med=7.75s max=9.47s p(90)=8.89s p(95)=9.06s iterations.....................: 449 11.963917/s vus............................: 14 min=14 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview