search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency @types/node to v20.11.30 #407

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@types/node (source) 20.11.29 -> 20.11.30 age adoption passing confidence

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 165 5037 total, 0 failed avg: 536ms, p95: 740ms ✅
wundergraph 103 3197 total, 0 failed avg: 912ms, p95: 1140ms ✅
mesh-supergraph-bun 98 3038 total, 0 failed avg: 958ms, p95: 1383ms ✅
cosmo 81 2508 total, 0 failed avg: 1178ms, p95: 1431ms ✅
apollo-server 60 1874 total, 0 failed avg: 1618ms, p95: 1916ms ✅
mesh-supergraph 60 1861 total, 0 failed avg: 1619ms, p95: 2477ms ✅
mercurius 12 471 total, 0 failed avg: 7217ms, p95: 8461ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15111 ✗ 0 data_received..................: 442 MB 15 MB/s data_sent......................: 6.0 MB 196 kB/s http_req_blocked...............: avg=59.73µs min=1.56µs med=2.83µs max=9.75ms p(90)=4.07µs p(95)=5.56µs http_req_connecting............: avg=48.77µs min=0s med=0s max=9.17ms p(90)=0s p(95)=0s http_req_duration..............: avg=535.87ms min=227.76ms med=523.12ms max=1.11s p(90)=679.2ms p(95)=739.77ms { expected_response:true }...: avg=535.87ms min=227.76ms med=523.12ms max=1.11s p(90)=679.2ms p(95)=739.77ms http_req_failed................: 0.00% ✓ 0 ✗ 5037 http_req_receiving.............: avg=12.65ms min=34.96µs med=71.34µs max=390.06ms p(90)=48.23ms p(95)=89.39ms http_req_sending...............: avg=1.94ms min=8.21µs med=13.35µs max=373.4ms p(90)=40.06µs p(95)=960.75µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=521.27ms min=227.55ms med=513.4ms max=953.7ms p(90)=651.64ms p(95)=705.38ms http_reqs......................: 5037 165.438363/s iteration_duration.............: avg=599.36ms min=243.48ms med=582.15ms max=1.34s p(90)=779.09ms p(95)=843.99ms iterations.....................: 5037 165.438363/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9591 ✗ 0 data_received..................: 281 MB 9.1 MB/s data_sent......................: 3.8 MB 123 kB/s http_req_blocked...............: avg=38.66µs min=1.15µs med=2.55µs max=4.58ms p(90)=3.86µs p(95)=7.96µs http_req_connecting............: avg=29.61µs min=0s med=0s max=3.83ms p(90)=0s p(95)=0s http_req_duration..............: avg=911.81ms min=534.27ms med=902.6ms max=1.53s p(90)=1.06s p(95)=1.13s { expected_response:true }...: avg=911.81ms min=534.27ms med=902.6ms max=1.53s p(90)=1.06s p(95)=1.13s http_req_failed................: 0.00% ✓ 0 ✗ 3197 http_req_receiving.............: avg=7.54ms min=39.55µs med=74.22µs max=303.26ms p(90)=11.96ms p(95)=62.42ms http_req_sending...............: avg=1.57ms min=7.78µs med=12.87µs max=275.56ms p(90)=34.97µs p(95)=547.1µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=902.69ms min=533.9ms med=896.9ms max=1.47s p(90)=1.04s p(95)=1.11s http_reqs......................: 3197 103.649143/s iteration_duration.............: avg=950.95ms min=543.39ms med=935.86ms max=1.54s p(90)=1.11s p(95)=1.2s iterations.....................: 3197 103.649143/s vus............................: 99 min=99 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9114 ✗ 0 data_received..................: 267 MB 8.7 MB/s data_sent......................: 3.6 MB 117 kB/s http_req_blocked...............: avg=47.86µs min=1.64µs med=3.35µs max=52.03ms p(90)=5.34µs p(95)=10.36µs http_req_connecting............: avg=25.43µs min=0s med=0s max=9.56ms p(90)=0s p(95)=0s http_req_duration..............: avg=957.82ms min=384.62ms med=929.74ms max=2.33s p(90)=1.27s p(95)=1.38s { expected_response:true }...: avg=957.82ms min=384.62ms med=929.74ms max=2.33s p(90)=1.27s p(95)=1.38s http_req_failed................: 0.00% ✓ 0 ✗ 3038 http_req_receiving.............: avg=16.99ms min=38.32µs med=84.26µs max=775.37ms p(90)=8.88ms p(95)=107.77ms http_req_sending...............: avg=695.21µs min=8.82µs med=16.36µs max=116.18ms p(90)=52.91µs p(95)=391.2µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=940.14ms min=384.52ms med=915.24ms max=2.29s p(90)=1.23s p(95)=1.34s http_reqs......................: 3038 98.613756/s iteration_duration.............: avg=999.77ms min=395.81ms med=973.51ms max=2.44s p(90)=1.33s p(95)=1.44s iterations.....................: 3038 98.613756/s vus............................: 99 min=99 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7524 ✗ 0 data_received..................: 220 MB 7.1 MB/s data_sent......................: 3.0 MB 96 kB/s http_req_blocked...............: avg=82.33µs min=1.39µs med=2.74µs max=5.7ms p(90)=4.26µs p(95)=10.18µs http_req_connecting............: avg=76.16µs min=0s med=0s max=5.67ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.17s min=793.04ms med=1.17s max=1.82s p(90)=1.36s p(95)=1.43s { expected_response:true }...: avg=1.17s min=793.04ms med=1.17s max=1.82s p(90)=1.36s p(95)=1.43s http_req_failed................: 0.00% ✓ 0 ✗ 2508 http_req_receiving.............: avg=17.15ms min=39.48µs med=101.87µs max=447.84ms p(90)=65.35ms p(95)=108.32ms http_req_sending...............: avg=1.12ms min=8µs med=13.14µs max=249.34ms p(90)=55.06µs p(95)=453.1µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.15s min=779.25ms med=1.16s max=1.59s p(90)=1.34s p(95)=1.41s http_reqs......................: 2508 81.176199/s iteration_duration.............: avg=1.22s min=802.46ms med=1.2s max=1.86s p(90)=1.42s p(95)=1.51s iterations.....................: 2508 81.176199/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5622 ✗ 0 data_received..................: 165 MB 5.3 MB/s data_sent......................: 2.2 MB 72 kB/s http_req_blocked...............: avg=177.92µs min=1.99µs med=4.38µs max=6.26ms p(90)=6.15µs p(95)=559.64µs http_req_connecting............: avg=171.04µs min=0s med=0s max=6.1ms p(90)=0s p(95)=492.98µs http_req_duration..............: avg=1.61s min=888.46ms med=1.54s max=9.67s p(90)=1.81s p(95)=1.91s { expected_response:true }...: avg=1.61s min=888.46ms med=1.54s max=9.67s p(90)=1.81s p(95)=1.91s http_req_failed................: 0.00% ✓ 0 ✗ 1874 http_req_receiving.............: avg=425.66µs min=46.93µs med=119.39µs max=70.55ms p(90)=198.79µs p(95)=329.27µs http_req_sending...............: avg=169.56µs min=10.1µs med=24.44µs max=34.11ms p(90)=41.77µs p(95)=893.21µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.61s min=888.27ms med=1.54s max=9.67s p(90)=1.81s p(95)=1.91s http_reqs......................: 1874 60.229725/s iteration_duration.............: avg=1.63s min=896.65ms med=1.55s max=9.68s p(90)=1.83s p(95)=1.94s iterations.....................: 1874 60.229725/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5583 ✗ 0 data_received..................: 163 MB 5.3 MB/s data_sent......................: 2.2 MB 71 kB/s http_req_blocked...............: avg=159.38µs min=2.04µs med=4.52µs max=6.72ms p(90)=6.37µs p(95)=558.01µs http_req_connecting............: avg=151.17µs min=0s med=0s max=6.57ms p(90)=0s p(95)=532µs http_req_duration..............: avg=1.61s min=853.72ms med=1.5s max=4.53s p(90)=2.22s p(95)=2.47s { expected_response:true }...: avg=1.61s min=853.72ms med=1.5s max=4.53s p(90)=2.22s p(95)=2.47s http_req_failed................: 0.00% ✓ 0 ✗ 1861 http_req_receiving.............: avg=1.95ms min=45.47µs med=133.55µs max=123.54ms p(90)=3.01ms p(95)=9.89ms http_req_sending...............: avg=79.16µs min=9.26µs med=24.99µs max=33.23ms p(90)=43.94µs p(95)=151.04µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.61s min=853.59ms med=1.5s max=4.53s p(90)=2.22s p(95)=2.47s http_reqs......................: 1861 60.059935/s iteration_duration.............: avg=1.64s min=867.74ms med=1.52s max=4.55s p(90)=2.25s p(95)=2.5s iterations.....................: 1861 60.059935/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1413 ✗ 0 data_received..................: 41 MB 1.1 MB/s data_sent......................: 559 kB 15 kB/s http_req_blocked...............: avg=399.13µs min=1.61µs med=3.84µs max=7.31ms p(90)=1.64ms p(95)=2.95ms http_req_connecting............: avg=323.89µs min=0s med=0s max=5.79ms p(90)=1.36ms p(95)=2.63ms http_req_duration..............: avg=7.21s min=2.8s med=7.52s max=8.68s p(90)=8.32s p(95)=8.46s { expected_response:true }...: avg=7.21s min=2.8s med=7.52s max=8.68s p(90)=8.32s p(95)=8.46s http_req_failed................: 0.00% ✓ 0 ✗ 471 http_req_receiving.............: avg=139.11µs min=61.72µs med=122.4µs max=2.37ms p(90)=181.71µs p(95)=204.25µs http_req_sending...............: avg=200.26µs min=9.39µs med=22.15µs max=6.76ms p(90)=1.08ms p(95)=1.35ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.21s min=2.8s med=7.52s max=8.68s p(90)=8.32s p(95)=8.46s http_reqs......................: 471 12.568099/s iteration_duration.............: avg=7.22s min=2.81s med=7.53s max=8.69s p(90)=8.33s p(95)=8.46s iterations.....................: 471 12.568099/s vus............................: 11 min=11 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 175 5323 total, 0 failed avg: 490ms, p95: 703ms ✅
apollo-router 167 5107 total, 0 failed avg: 540ms, p95: 720ms ✅
wundergraph 158 4821 total, 0 failed avg: 531ms, p95: 950ms ✅
mesh-supergraph-bun 95 2922 total, 0 failed avg: 1009ms, p95: 1704ms ✅
apollo-server 46 1452 total, 0 failed avg: 2103ms, p95: 3302ms ✅
mercurius 30 941 total, 0 failed avg: 3250ms, p95: 4871ms ✅
mesh-supergraph 30 976 total, 0 failed avg: 3170ms, p95: 5141ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15969 ✗ 0 data_received..................: 467 MB 15 MB/s data_sent......................: 6.3 MB 208 kB/s http_req_blocked...............: avg=18.41µs min=1.23µs med=2.68µs max=7.1ms p(90)=4.09µs p(95)=5.14µs http_req_connecting............: avg=11.51µs min=0s med=0s max=1.88ms p(90)=0s p(95)=0s http_req_duration..............: avg=490.11ms min=34.65ms med=492ms max=2.24s p(90)=617.64ms p(95)=702.8ms { expected_response:true }...: avg=490.11ms min=34.65ms med=492ms max=2.24s p(90)=617.64ms p(95)=702.8ms http_req_failed................: 0.00% ✓ 0 ✗ 5323 http_req_receiving.............: avg=35.97ms min=37.49µs med=72.14µs max=2s p(90)=90.19ms p(95)=293.88ms http_req_sending...............: avg=1.68ms min=7.55µs med=13.16µs max=622.35ms p(90)=37.28µs p(95)=186.54µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=452.45ms min=26.4ms med=476.18ms max=852.76ms p(90)=567.88ms p(95)=599.54ms http_reqs......................: 5323 175.118529/s iteration_duration.............: avg=568.45ms min=59.68ms med=535.11ms max=2.52s p(90)=788.02ms p(95)=948.14ms iterations.....................: 5323 175.118529/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15321 ✗ 0 data_received..................: 448 MB 15 MB/s data_sent......................: 6.1 MB 199 kB/s http_req_blocked...............: avg=31.24µs min=1.48µs med=2.84µs max=27.88ms p(90)=4.52µs p(95)=5.58µs http_req_connecting............: avg=17.77µs min=0s med=0s max=3.11ms p(90)=0s p(95)=0s http_req_duration..............: avg=540.29ms min=11.18ms med=534.65ms max=1.15s p(90)=675.75ms p(95)=719.69ms { expected_response:true }...: avg=540.29ms min=11.18ms med=534.65ms max=1.15s p(90)=675.75ms p(95)=719.69ms http_req_failed................: 0.00% ✓ 0 ✗ 5107 http_req_receiving.............: avg=14.14ms min=36.44µs med=69.58µs max=726.39ms p(90)=29.08ms p(95)=75.66ms http_req_sending...............: avg=1.03ms min=7.48µs med=13.63µs max=457.28ms p(90)=35.83µs p(95)=752.19µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=525.12ms min=11.12ms med=523.69ms max=846.46ms p(90)=654.63ms p(95)=693.23ms http_reqs......................: 5107 167.771543/s iteration_duration.............: avg=592.46ms min=21.86ms med=576.86ms max=1.42s p(90)=746.09ms p(95)=820.35ms iterations.....................: 5107 167.771543/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14463 ✗ 0 data_received..................: 423 MB 14 MB/s data_sent......................: 5.7 MB 188 kB/s http_req_blocked...............: avg=54.23µs min=1.29µs med=2.69µs max=9.87ms p(90)=4.3µs p(95)=5.51µs http_req_connecting............: avg=47.79µs min=0s med=0s max=9.71ms p(90)=0s p(95)=0s http_req_duration..............: avg=531.49ms min=16.81ms med=512.81ms max=2.05s p(90)=823.21ms p(95)=949.9ms { expected_response:true }...: avg=531.49ms min=16.81ms med=512.81ms max=2.05s p(90)=823.21ms p(95)=949.9ms http_req_failed................: 0.00% ✓ 0 ✗ 4821 http_req_receiving.............: avg=48.56ms min=38.84µs med=84.03µs max=1.29s p(90)=115.52ms p(95)=328.59ms http_req_sending...............: avg=2.75ms min=7.13µs med=13.15µs max=1.3s p(90)=31.46µs p(95)=137.12µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=480.18ms min=16.18ms med=474.16ms max=1.21s p(90)=766.95ms p(95)=854.07ms http_reqs......................: 4821 158.155061/s iteration_duration.............: avg=628.47ms min=29.22ms med=588.3ms max=3.64s p(90)=987.47ms p(95)=1.15s iterations.....................: 4821 158.155061/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8766 ✗ 0 data_received..................: 256 MB 8.4 MB/s data_sent......................: 3.5 MB 113 kB/s http_req_blocked...............: avg=59.06µs min=1.29µs med=2.88µs max=59.77ms p(90)=4.71µs p(95)=9.56µs http_req_connecting............: avg=26.86µs min=0s med=0s max=2.43ms p(90)=0s p(95)=0s http_req_duration..............: avg=1s min=196.08ms med=899.18ms max=2.77s p(90)=1.53s p(95)=1.7s { expected_response:true }...: avg=1s min=196.08ms med=899.18ms max=2.77s p(90)=1.53s p(95)=1.7s http_req_failed................: 0.00% ✓ 0 ✗ 2922 http_req_receiving.............: avg=10.91ms min=40.22µs med=87.53µs max=808.76ms p(90)=791.46µs p(95)=40.17ms http_req_sending...............: avg=353.48µs min=8.06µs med=13.93µs max=102.74ms p(90)=33.02µs p(95)=195.69µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=998.14ms min=195.69ms med=891.34ms max=2.77s p(90)=1.52s p(95)=1.7s http_reqs......................: 2922 95.188306/s iteration_duration.............: avg=1.03s min=204.41ms med=927.29ms max=2.78s p(90)=1.56s p(95)=1.74s iterations.....................: 2922 95.188306/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4356 ✗ 0 data_received..................: 128 MB 4.1 MB/s data_sent......................: 1.7 MB 55 kB/s http_req_blocked...............: avg=61µs min=1.85µs med=4.72µs max=8.28ms p(90)=6.55µs p(95)=180.53µs http_req_connecting............: avg=43.66µs min=0s med=0s max=3.05ms p(90)=0s p(95)=136.21µs http_req_duration..............: avg=2.1s min=427.53ms med=1.68s max=23.15s p(90)=2.17s p(95)=3.3s { expected_response:true }...: avg=2.1s min=427.53ms med=1.68s max=23.15s p(90)=2.17s p(95)=3.3s http_req_failed................: 0.00% ✓ 0 ✗ 1452 http_req_receiving.............: avg=205.04µs min=59.32µs med=136.52µs max=28.16ms p(90)=191.19µs p(95)=215.83µs http_req_sending...............: avg=48.54µs min=10.33µs med=26.34µs max=6.59ms p(90)=40.07µs p(95)=90.7µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.1s min=427.34ms med=1.68s max=23.15s p(90)=2.17s p(95)=3.3s http_reqs......................: 1452 46.474711/s iteration_duration.............: avg=2.11s min=440.81ms med=1.69s max=23.16s p(90)=2.18s p(95)=3.31s iterations.....................: 1452 46.474711/s vus............................: 26 min=26 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2823 ✗ 0 data_received..................: 83 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=171.32µs min=1.62µs med=3.76µs max=4.89ms p(90)=104.16µs p(95)=1.28ms http_req_connecting............: avg=162.12µs min=0s med=0s max=4.85ms p(90)=70.65µs p(95)=1.24ms http_req_duration..............: avg=3.24s min=472.99ms med=2.99s max=8.34s p(90)=4.39s p(95)=4.87s { expected_response:true }...: avg=3.24s min=472.99ms med=2.99s max=8.34s p(90)=4.39s p(95)=4.87s http_req_failed................: 0.00% ✓ 0 ✗ 941 http_req_receiving.............: avg=266.22µs min=46.39µs med=117.74µs max=71.71ms p(90)=189.62µs p(95)=281.31µs http_req_sending...............: avg=86.2µs min=9.14µs med=21.15µs max=1.11ms p(90)=63.25µs p(95)=943.55µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.24s min=472.72ms med=2.99s max=8.34s p(90)=4.39s p(95)=4.87s http_reqs......................: 941 30.363522/s iteration_duration.............: avg=3.26s min=483.88ms med=3s max=8.35s p(90)=4.4s p(95)=4.88s iterations.....................: 941 30.363522/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2928 ✗ 0 data_received..................: 86 MB 2.7 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=43.63µs min=1.35µs med=3.7µs max=1.33ms p(90)=95.99µs p(95)=315.7µs http_req_connecting............: avg=36.54µs min=0s med=0s max=1.3ms p(90)=65.1µs p(95)=283.81µs http_req_duration..............: avg=3.17s min=1.45s med=2.95s max=7.37s p(90)=4.55s p(95)=5.14s { expected_response:true }...: avg=3.17s min=1.45s med=2.95s max=7.37s p(90)=4.55s p(95)=5.14s http_req_failed................: 0.00% ✓ 0 ✗ 976 http_req_receiving.............: avg=4.03ms min=38.45µs med=148.03µs max=92.89ms p(90)=3.98ms p(95)=25.02ms http_req_sending...............: avg=49.6µs min=8.2µs med=19.69µs max=5.87ms p(90)=46.56µs p(95)=209.46µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.16s min=1.45s med=2.92s max=7.37s p(90)=4.55s p(95)=5.13s http_reqs......................: 976 30.712555/s iteration_duration.............: avg=3.18s min=1.46s med=2.97s max=7.38s p(90)=4.57s p(95)=5.15s iterations.....................: 976 30.712555/s vus............................: 66 min=66 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 149 4545 total, 0 failed avg: 618ms, p95: 803ms ✅
wundergraph 103 3201 total, 0 failed avg: 920ms, p95: 1179ms ✅
mesh-supergraph-bun 81 2515 total, 0 failed avg: 1179ms, p95: 1882ms ✅
cosmo 77 2429 total, 0 failed avg: 1215ms, p95: 1418ms ✅
apollo-server 44 1397 total, 0 failed avg: 2197ms, p95: 2502ms ✅
mesh-supergraph 29 945 total, 0 failed avg: 3285ms, p95: 5366ms ✅
mercurius 12 453 total, 0 failed avg: 7522ms, p95: 8970ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13635 ✗ 0 data_received..................: 399 MB 13 MB/s data_sent......................: 5.4 MB 177 kB/s http_req_blocked...............: avg=46.07µs min=1.59µs med=3.16µs max=32.74ms p(90)=4.99µs p(95)=7.15µs http_req_connecting............: avg=23.39µs min=0s med=0s max=4.15ms p(90)=0s p(95)=0s http_req_duration..............: avg=617.8ms min=305.76ms med=611.82ms max=1.23s p(90)=752.19ms p(95)=802.6ms { expected_response:true }...: avg=617.8ms min=305.76ms med=611.82ms max=1.23s p(90)=752.19ms p(95)=802.6ms http_req_failed................: 0.00% ✓ 0 ✗ 4545 http_req_receiving.............: avg=11.36ms min=35.58µs med=74.46µs max=478.31ms p(90)=31.52ms p(95)=79.52ms http_req_sending...............: avg=886.35µs min=8.24µs med=14.76µs max=186.18ms p(90)=38.66µs p(95)=287.29µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=605.55ms min=305.69ms med=602.81ms max=930.55ms p(90)=729.72ms p(95)=777.31ms http_reqs......................: 4545 149.025376/s iteration_duration.............: avg=666.03ms min=327ms med=651.38ms max=1.26s p(90)=825.26ms p(95)=885.85ms iterations.....................: 4545 149.025376/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9603 ✗ 0 data_received..................: 281 MB 9.1 MB/s data_sent......................: 3.8 MB 123 kB/s http_req_blocked...............: avg=30.2µs min=1.47µs med=2.88µs max=2.77ms p(90)=4.57µs p(95)=8.55µs http_req_connecting............: avg=22.88µs min=0s med=0s max=2.73ms p(90)=0s p(95)=0s http_req_duration..............: avg=920.48ms min=570.88ms med=896.79ms max=1.5s p(90)=1.09s p(95)=1.17s { expected_response:true }...: avg=920.48ms min=570.88ms med=896.79ms max=1.5s p(90)=1.09s p(95)=1.17s http_req_failed................: 0.00% ✓ 0 ✗ 3201 http_req_receiving.............: avg=7.75ms min=36.56µs med=80.46µs max=294.1ms p(90)=23.22ms p(95)=52.71ms http_req_sending...............: avg=1.37ms min=8.3µs med=13.37µs max=225.81ms p(90)=37.89µs p(95)=304.55µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=911.34ms min=570.37ms med=888.95ms max=1.31s p(90)=1.08s p(95)=1.16s http_reqs......................: 3201 103.62033/s iteration_duration.............: avg=957.2ms min=601.88ms med=932.78ms max=1.51s p(90)=1.14s p(95)=1.23s iterations.....................: 3201 103.62033/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7545 ✗ 0 data_received..................: 221 MB 7.1 MB/s data_sent......................: 3.0 MB 97 kB/s http_req_blocked...............: avg=49.85µs min=1.42µs med=3.11µs max=12.27ms p(90)=5.06µs p(95)=10.97µs http_req_connecting............: avg=37.03µs min=0s med=0s max=6.63ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.17s min=508.57ms med=1.11s max=2.5s p(90)=1.67s p(95)=1.88s { expected_response:true }...: avg=1.17s min=508.57ms med=1.11s max=2.5s p(90)=1.67s p(95)=1.88s http_req_failed................: 0.00% ✓ 0 ✗ 2515 http_req_receiving.............: avg=15.46ms min=39.58µs med=98.33µs max=668.53ms p(90)=4.94ms p(95)=75.02ms http_req_sending...............: avg=374.24µs min=7.79µs med=14.8µs max=123.56ms p(90)=40.76µs p(95)=167.27µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.16s min=506.26ms med=1.09s max=2.33s p(90)=1.65s p(95)=1.87s http_reqs......................: 2515 81.335134/s iteration_duration.............: avg=1.2s min=517.12ms med=1.14s max=2.52s p(90)=1.68s p(95)=1.93s iterations.....................: 2515 81.335134/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7287 ✗ 0 data_received..................: 213 MB 6.8 MB/s data_sent......................: 2.9 MB 92 kB/s http_req_blocked...............: avg=28.76µs min=1.5µs med=2.95µs max=32.27ms p(90)=4.97µs p(95)=10.76µs http_req_connecting............: avg=9.98µs min=0s med=0s max=762.18µs p(90)=0s p(95)=0s http_req_duration..............: avg=1.21s min=837.04ms med=1.21s max=1.67s p(90)=1.38s p(95)=1.41s { expected_response:true }...: avg=1.21s min=837.04ms med=1.21s max=1.67s p(90)=1.38s p(95)=1.41s http_req_failed................: 0.00% ✓ 0 ✗ 2429 http_req_receiving.............: avg=7.46ms min=39.74µs med=82.66µs max=296.16ms p(90)=13.98ms p(95)=59.34ms http_req_sending...............: avg=1.01ms min=8.13µs med=13.68µs max=164.76ms p(90)=36.29µs p(95)=187.68µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.2s min=836.98ms med=1.21s max=1.6s p(90)=1.36s p(95)=1.4s http_reqs......................: 2429 77.75379/s iteration_duration.............: avg=1.25s min=851.52ms med=1.24s max=1.72s p(90)=1.42s p(95)=1.49s iterations.....................: 2429 77.75379/s vus............................: 16 min=16 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4191 ✗ 0 data_received..................: 123 MB 3.9 MB/s data_sent......................: 1.7 MB 53 kB/s http_req_blocked...............: avg=99.01µs min=2.39µs med=4.83µs max=7.38ms p(90)=6.78µs p(95)=280.35µs http_req_connecting............: avg=86.18µs min=0s med=0s max=7.34ms p(90)=0s p(95)=223.54µs http_req_duration..............: avg=2.19s min=1s med=1.93s max=15.23s p(90)=2.37s p(95)=2.5s { expected_response:true }...: avg=2.19s min=1s med=1.93s max=15.23s p(90)=2.37s p(95)=2.5s http_req_failed................: 0.00% ✓ 0 ✗ 1397 http_req_receiving.............: avg=193.98µs min=68.12µs med=138.51µs max=17.17ms p(90)=201.49µs p(95)=240.72µs http_req_sending...............: avg=49.09µs min=11.71µs med=27.71µs max=3.75ms p(90)=42.17µs p(95)=105.12µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.19s min=1s med=1.93s max=15.23s p(90)=2.37s p(95)=2.5s http_reqs......................: 1397 44.416466/s iteration_duration.............: avg=2.2s min=1.01s med=1.93s max=15.24s p(90)=2.39s p(95)=2.51s iterations.....................: 1397 44.416466/s vus............................: 41 min=41 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2835 ✗ 0 data_received..................: 83 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=108.09µs min=1.45µs med=4.02µs max=3.82ms p(90)=109.88µs p(95)=344.79µs http_req_connecting............: avg=89.57µs min=0s med=0s max=3.74ms p(90)=76.54µs p(95)=299.9µs http_req_duration..............: avg=3.28s min=1.57s med=3.09s max=6.37s p(90)=4.5s p(95)=5.36s { expected_response:true }...: avg=3.28s min=1.57s med=3.09s max=6.37s p(90)=4.5s p(95)=5.36s http_req_failed................: 0.00% ✓ 0 ✗ 945 http_req_receiving.............: avg=3.1ms min=43.79µs med=150.85µs max=79.54ms p(90)=2.89ms p(95)=11.29ms http_req_sending...............: avg=74.39µs min=8.05µs med=22.01µs max=17.04ms p(90)=66.13µs p(95)=234.48µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.28s min=1.57s med=3.08s max=6.37s p(90)=4.49s p(95)=5.36s http_reqs......................: 945 29.710588/s iteration_duration.............: avg=3.29s min=1.58s med=3.1s max=6.38s p(90)=4.5s p(95)=5.38s iterations.....................: 945 29.710588/s vus............................: 67 min=67 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1359 ✗ 0 data_received..................: 40 MB 1.1 MB/s data_sent......................: 538 kB 14 kB/s http_req_blocked...............: avg=333.91µs min=1.57µs med=3.36µs max=3.82ms p(90)=1.43ms p(95)=2.64ms http_req_connecting............: avg=317.94µs min=0s med=0s max=3.8ms p(90)=1.36ms p(95)=2.61ms http_req_duration..............: avg=7.52s min=3.47s med=7.76s max=9.23s p(90)=8.74s p(95)=8.96s { expected_response:true }...: avg=7.52s min=3.47s med=7.76s max=9.23s p(90)=8.74s p(95)=8.96s http_req_failed................: 0.00% ✓ 0 ✗ 453 http_req_receiving.............: avg=187.1µs min=57.69µs med=118.67µs max=19.96ms p(90)=195.65µs p(95)=227.77µs http_req_sending...............: avg=108.39µs min=9.39µs med=19.85µs max=1.89ms p(90)=491.1µs p(95)=608.85µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.52s min=3.47s med=7.76s max=9.23s p(90)=8.74s p(95)=8.96s http_reqs......................: 453 12.028049/s iteration_duration.............: avg=7.53s min=3.48s med=7.77s max=9.24s p(90)=8.76s p(95)=8.97s iterations.....................: 453 12.028049/s vus............................: 15 min=15 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2586ms 171 12004 total, 0 failed avg: 797ms, p95: 2586ms, max: 5514ms, med: 528ms ❌ 2 unexpected GraphQL errors, non-compatible response structure (2)
wundergraph 2648ms 166 11656 total, 0 failed avg: 814ms, p95: 2649ms, max: 9039ms, med: 480ms ✅
apollo-router 2706ms 168 11830 total, 0 failed avg: 810ms, p95: 2706ms, max: 6795ms, med: 471ms ✅
mesh-supergraph-bun 5502ms 116 8146 total, 0 failed avg: 2238ms, p95: 5503ms, max: 8731ms, med: 2061ms ✅
mesh-supergraph 6837ms 67 4723 total, 0 failed avg: 4041ms, p95: 6837ms, max: 8181ms, med: 4155ms ✅
apollo-server 23811ms 68 5013 total, 0 failed avg: 4156ms, p95: 23812ms, max: 44884ms, med: 2247ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 12002 / ✗ 2 ✗ valid response structure ↳ 99% — ✓ 12002 / ✗ 2 checks.........................: 99.98% ✓ 36008 ✗ 4 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 204 kB/s http_req_blocked...............: avg=17.13ms min=1.6µs med=3.29µs max=3.32s p(90)=5.64µs p(95)=19.45µs http_req_connecting............: avg=16.83ms min=0s med=0s max=3.32s p(90)=0s p(95)=0s http_req_duration..............: avg=797.44ms min=6.92ms med=528.15ms max=5.51s p(90)=1.91s p(95)=2.58s { expected_response:true }...: avg=797.44ms min=6.92ms med=528.15ms max=5.51s p(90)=1.91s p(95)=2.58s http_req_failed................: 0.00% ✓ 0 ✗ 12004 http_req_receiving.............: avg=310.35ms min=29.43µs med=86.15µs max=5.03s p(90)=1.18s p(95)=2s http_req_sending...............: avg=31.44ms min=8.4µs med=15.79µs max=3.82s p(90)=337.4µs p(95)=72.6ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=455.64ms min=6.81ms med=353.81ms max=2.28s p(90)=943.94ms p(95)=1.2s http_reqs......................: 12004 171.466099/s iteration_duration.............: avg=1.51s min=12.34ms med=992.43ms max=11.65s p(90)=3.63s p(95)=4.65s iterations.....................: 12004 171.466099/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34968 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 198 kB/s http_req_blocked...............: avg=18.74ms min=1.44µs med=3.01µs max=4.37s p(90)=4.71µs p(95)=14.26µs http_req_connecting............: avg=15.7ms min=0s med=0s max=4.17s p(90)=0s p(95)=0s http_req_duration..............: avg=814.42ms min=6.52ms med=479.87ms max=9.03s p(90)=1.95s p(95)=2.64s { expected_response:true }...: avg=814.42ms min=6.52ms med=479.87ms max=9.03s p(90)=1.95s p(95)=2.64s http_req_failed................: 0.00% ✓ 0 ✗ 11656 http_req_receiving.............: avg=361.44ms min=31.95µs med=89.09µs max=6.08s p(90)=1.25s p(95)=2.01s http_req_sending...............: avg=37.31ms min=7.65µs med=13.92µs max=5.1s p(90)=400.22µs p(95)=77.67ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=415.66ms min=6.43ms med=322.54ms max=2.18s p(90)=915.48ms p(95)=1.08s http_reqs......................: 11656 166.501845/s iteration_duration.............: avg=1.57s min=11.91ms med=999.57ms max=13.17s p(90)=3.8s p(95)=4.93s iterations.....................: 11656 166.501845/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35490 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 201 kB/s http_req_blocked...............: avg=12.45ms min=1.77µs med=3.65µs max=3.78s p(90)=6.12µs p(95)=14.74µs http_req_connecting............: avg=11.37ms min=0s med=0s max=3.75s p(90)=0s p(95)=0s http_req_duration..............: avg=810.38ms min=6.81ms med=471.32ms max=6.79s p(90)=2.03s p(95)=2.7s { expected_response:true }...: avg=810.38ms min=6.81ms med=471.32ms max=6.79s p(90)=2.03s p(95)=2.7s http_req_failed................: 0.00% ✓ 0 ✗ 11830 http_req_receiving.............: avg=349.93ms min=33.06µs med=90.86µs max=6.31s p(90)=1.26s p(95)=2.15s http_req_sending...............: avg=37.97ms min=8.56µs med=17.26µs max=3.17s p(90)=339.49µs p(95)=58.45ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=422.47ms min=6.74ms med=365.89ms max=2.57s p(90)=793.28ms p(95)=963.67ms http_reqs......................: 11830 168.981522/s iteration_duration.............: avg=1.54s min=12.32ms med=922.29ms max=11.36s p(90)=3.75s p(95)=4.83s iterations.....................: 11830 168.981522/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24438 ✗ 0 data_received..................: 715 MB 10 MB/s data_sent......................: 9.7 MB 138 kB/s http_req_blocked...............: avg=2.06ms min=1.44µs med=3.15µs max=414.47ms p(90)=5.7µs p(95)=240.72µs http_req_connecting............: avg=1.97ms min=0s med=0s max=361.43ms p(90)=0s p(95)=160.91µs http_req_duration..............: avg=2.23s min=5.83ms med=2.06s max=8.73s p(90)=4.56s p(95)=5.5s { expected_response:true }...: avg=2.23s min=5.83ms med=2.06s max=8.73s p(90)=4.56s p(95)=5.5s http_req_failed................: 0.00% ✓ 0 ✗ 8146 http_req_receiving.............: avg=34.35ms min=34.9µs med=79.78µs max=1.28s p(90)=86.41ms p(95)=256.22ms http_req_sending...............: avg=3.87ms min=8.58µs med=15µs max=933.91ms p(90)=95.66µs p(95)=10.03ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.2s min=5.65ms med=2.04s max=8.63s p(90)=4.36s p(95)=5.3s http_reqs......................: 8146 116.350836/s iteration_duration.............: avg=2.31s min=13.05ms med=2.12s max=9.05s p(90)=4.6s p(95)=5.55s iterations.....................: 8146 116.350836/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14169 ✗ 0 data_received..................: 414 MB 5.9 MB/s data_sent......................: 5.6 MB 80 kB/s http_req_blocked...............: avg=434.11µs min=1.4µs med=4.65µs max=160ms p(90)=191.21µs p(95)=430.33µs http_req_connecting............: avg=413.42µs min=0s med=0s max=159.94ms p(90)=132.12µs p(95)=352.91µs http_req_duration..............: avg=4.04s min=10.96ms med=4.15s max=8.18s p(90)=6.45s p(95)=6.83s { expected_response:true }...: avg=4.04s min=10.96ms med=4.15s max=8.18s p(90)=6.45s p(95)=6.83s http_req_failed................: 0.00% ✓ 0 ✗ 4723 http_req_receiving.............: avg=2.87ms min=36.52µs med=116.8µs max=817.58ms p(90)=1.84ms p(95)=9.82ms http_req_sending...............: avg=432.26µs min=8.1µs med=25.35µs max=131.92ms p(90)=55.3µs p(95)=138.7µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.03s min=10.85ms med=4.15s max=8.18s p(90)=6.45s p(95)=6.82s http_reqs......................: 4723 67.456324/s iteration_duration.............: avg=4.07s min=16.77ms med=4.17s max=8.23s p(90)=6.5s p(95)=6.88s iterations.....................: 4723 67.456324/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15039 ✗ 0 data_received..................: 441 MB 6.0 MB/s data_sent......................: 6.0 MB 81 kB/s http_req_blocked...............: avg=119.13µs min=1.48µs med=3.1µs max=78.72ms p(90)=29.37µs p(95)=261.45µs http_req_connecting............: avg=108.37µs min=0s med=0s max=78.54ms p(90)=0s p(95)=195.05µs http_req_duration..............: avg=4.15s min=89.1ms med=2.24s max=44.88s p(90)=3.74s p(95)=23.81s { expected_response:true }...: avg=4.15s min=89.1ms med=2.24s max=44.88s p(90)=3.74s p(95)=23.81s http_req_failed................: 0.00% ✓ 0 ✗ 5013 http_req_receiving.............: avg=306.24µs min=45.79µs med=115.21µs max=193.15ms p(90)=178.32µs p(95)=211.27µs http_req_sending...............: avg=58.44µs min=8.17µs med=15.72µs max=20.02ms p(90)=40.14µs p(95)=60.79µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.15s min=88.98ms med=2.24s max=44.88s p(90)=3.74s p(95)=23.81s http_reqs......................: 5013 68.55931/s iteration_duration.............: avg=4.16s min=113.75ms med=2.26s max=44.89s p(90)=3.75s p(95)=23.82s iterations.....................: 5013 68.55931/s vus............................: 15 min=15 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview