the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency @types/node to v20.11.28 #391

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@types/node (source) 20.11.26 -> 20.11.28 age adoption passing confidence

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.



This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 165 5049 total, 0 failed avg: 534ms, p95: 749ms
mesh-supergraph-bun 103 3173 total, 0 failed avg: 917ms, p95: 1340ms
wundergraph 102 3128 total, 0 failed avg: 932ms, p95: 1175ms
cosmo 79 2472 total, 0 failed avg: 1202ms, p95: 1555ms
apollo-server 63 1965 total, 0 failed avg: 1539ms, p95: 1911ms
mesh-supergraph 62 1934 total, 0 failed avg: 1556ms, p95: 2244ms
mercurius 12 475 total, 0 failed avg: 7169ms, p95: 8480ms
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15147 ✗ 0 data_received..................: 443 MB 15 MB/s data_sent......................: 6.0 MB 197 kB/s http_req_blocked...............: avg=71.14µs min=1.36µs med=2.95µs max=61.91ms p(90)=4.61µs p(95)=5.84µs http_req_connecting............: avg=54.35µs min=0s med=0s max=5.95ms p(90)=0s p(95)=0s http_req_duration..............: avg=534.42ms min=236.64ms med=518.76ms max=1.2s p(90)=668.01ms p(95)=748.72ms { expected_response:true }...: avg=534.42ms min=236.64ms med=518.76ms max=1.2s p(90)=668.01ms p(95)=748.72ms http_req_failed................: 0.00% ✓ 0 ✗ 5049 http_req_receiving.............: avg=19.09ms min=35.1µs med=77.44µs max=520.9ms p(90)=66.86ms p(95)=125.84ms http_req_sending...............: avg=2.24ms min=8.6µs med=13.86µs max=482.76ms p(90)=65.98µs p(95)=933.91µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=513.08ms min=236.58ms med=505.65ms max=919.72ms p(90)=634.43ms p(95)=680.55ms http_reqs......................: 5049 165.641476/s iteration_duration.............: avg=599.37ms min=246.15ms med=571.78ms max=1.26s p(90)=782.3ms p(95)=871.03ms iterations.....................: 5049 165.641476/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9519 ✗ 0 data_received..................: 278 MB 9.1 MB/s data_sent......................: 3.8 MB 123 kB/s http_req_blocked...............: avg=149.92µs min=1.49µs med=2.85µs max=11.64ms p(90)=4.4µs p(95)=5.8µs http_req_connecting............: avg=145.21µs min=0s med=0s max=11.48ms p(90)=0s p(95)=0s http_req_duration..............: avg=916.8ms min=351.77ms med=888.1ms max=1.93s p(90)=1.23s p(95)=1.33s { expected_response:true }...: avg=916.8ms min=351.77ms med=888.1ms max=1.93s p(90)=1.23s p(95)=1.33s http_req_failed................: 0.00% ✓ 0 ✗ 3173 http_req_receiving.............: avg=16.21ms min=35.83µs med=90.53µs max=702.36ms p(90)=14.33ms p(95)=107.95ms http_req_sending...............: avg=793.73µs min=7.94µs med=13.6µs max=316.67ms p(90)=36.9µs p(95)=679.87µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=899.79ms min=351.68ms med=874.51ms max=1.79s p(90)=1.19s p(95)=1.3s http_reqs......................: 3173 103.221758/s iteration_duration.............: avg=959.59ms min=360.68ms med=927.8ms max=1.94s p(90)=1.29s p(95)=1.41s iterations.....................: 3173 103.221758/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9384 ✗ 0 data_received..................: 275 MB 9.0 MB/s data_sent......................: 3.7 MB 121 kB/s http_req_blocked...............: avg=28.56µs min=1.3µs med=2.69µs max=2.51ms p(90)=4.3µs p(95)=7.17µs http_req_connecting............: avg=23.63µs min=0s med=0s max=2.48ms p(90)=0s p(95)=0s http_req_duration..............: avg=931.75ms min=606.82ms med=917.27ms max=1.63s p(90)=1.09s p(95)=1.17s { expected_response:true }...: avg=931.75ms min=606.82ms med=917.27ms max=1.63s p(90)=1.09s p(95)=1.17s http_req_failed................: 0.00% ✓ 0 ✗ 3128 http_req_receiving.............: avg=15.68ms min=40.01µs med=86.25µs max=428.47ms p(90)=58.8ms p(95)=104.04ms http_req_sending...............: avg=1.42ms min=7.74µs med=12.82µs max=318.7ms p(90)=49.05µs p(95)=319.62µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=914.65ms min=571.71ms med=908ms max=1.33s p(90)=1.06s p(95)=1.13s http_reqs......................: 3128 102.111732/s iteration_duration.............: avg=970.16ms min=616.5ms med=951.82ms max=1.65s p(90)=1.14s p(95)=1.22s iterations.....................: 3128 102.111732/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7416 ✗ 0 data_received..................: 217 MB 7.0 MB/s data_sent......................: 2.9 MB 95 kB/s http_req_blocked...............: avg=149.6µs min=1.2µs med=2.53µs max=132.89ms p(90)=4.02µs p(95)=9.67µs http_req_connecting............: avg=84.28µs min=0s med=0s max=4.92ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.2s min=761.09ms med=1.18s max=1.87s p(90)=1.44s p(95)=1.55s { expected_response:true }...: avg=1.2s min=761.09ms med=1.18s max=1.87s p(90)=1.44s p(95)=1.55s http_req_failed................: 0.00% ✓ 0 ✗ 2472 http_req_receiving.............: avg=15.58ms min=39.86µs med=80.93µs max=428.68ms p(90)=57.91ms p(95)=102.82ms http_req_sending...............: avg=1.6ms min=7.78µs med=12.53µs max=252.38ms p(90)=40.99µs p(95)=656.8µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.18s min=753.77ms med=1.16s max=1.79s p(90)=1.41s p(95)=1.51s http_reqs......................: 2472 79.934053/s iteration_duration.............: avg=1.23s min=771.67ms med=1.21s max=1.89s p(90)=1.5s p(95)=1.6s iterations.....................: 2472 79.934053/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5895 ✗ 0 data_received..................: 173 MB 5.6 MB/s data_sent......................: 2.3 MB 75 kB/s http_req_blocked...............: avg=82.75µs min=1.44µs med=3.17µs max=4.84ms p(90)=4.9µs p(95)=94.68µs http_req_connecting............: avg=73.97µs min=0s med=0s max=4.56ms p(90)=0s p(95)=63.05µs http_req_duration..............: avg=1.53s min=829.62ms med=1.45s max=9.33s p(90)=1.78s p(95)=1.91s { expected_response:true }...: avg=1.53s min=829.62ms med=1.45s max=9.33s p(90)=1.78s p(95)=1.91s http_req_failed................: 0.00% ✓ 0 ✗ 1965 http_req_receiving.............: avg=266.69µs min=44.69µs med=107.63µs max=45.33ms p(90)=181.78µs p(95)=270.18µs http_req_sending...............: avg=74.36µs min=8.92µs med=16.12µs max=25.52ms p(90)=32.04µs p(95)=88.88µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.53s min=828.8ms med=1.45s max=9.33s p(90)=1.78s p(95)=1.91s http_reqs......................: 1965 63.364709/s iteration_duration.............: avg=1.55s min=838.89ms med=1.47s max=9.35s p(90)=1.8s p(95)=1.92s iterations.....................: 1965 63.364709/s vus............................: 1 min=1 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5802 ✗ 0 data_received..................: 170 MB 5.5 MB/s data_sent......................: 2.3 MB 74 kB/s http_req_blocked...............: avg=127.49µs min=1.63µs med=4.16µs max=18.09ms p(90)=5.99µs p(95)=118.7µs http_req_connecting............: avg=114.06µs min=0s med=0s max=17.6ms p(90)=0s p(95)=72.19µs http_req_duration..............: avg=1.55s min=578.34ms med=1.5s max=3.2s p(90)=2.01s p(95)=2.24s { expected_response:true }...: avg=1.55s min=578.34ms med=1.5s max=3.2s p(90)=2.01s p(95)=2.24s http_req_failed................: 0.00% ✓ 0 ✗ 1934 http_req_receiving.............: avg=2ms min=40.81µs med=125.53µs max=110.64ms p(90)=3.32ms p(95)=10.83ms http_req_sending...............: avg=212.9µs min=9.12µs med=22.64µs max=82.33ms p(90)=43.79µs p(95)=274.07µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.55s min=578ms med=1.5s max=3.2s p(90)=2.01s p(95)=2.24s http_reqs......................: 1934 62.470467/s iteration_duration.............: avg=1.57s min=589.91ms med=1.53s max=3.24s p(90)=2.03s p(95)=2.29s iterations.....................: 1934 62.470467/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1425 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 564 kB 15 kB/s http_req_blocked...............: avg=266.55µs min=1.48µs med=3.4µs max=4.22ms p(90)=1.02ms p(95)=1.95ms http_req_connecting............: avg=253.26µs min=0s med=0s max=4.19ms p(90)=928.59µs p(95)=1.92ms http_req_duration..............: avg=7.16s min=3.48s med=7.41s max=8.9s p(90)=8.3s p(95)=8.47s { expected_response:true }...: avg=7.16s min=3.48s med=7.41s max=8.9s p(90)=8.3s p(95)=8.47s http_req_failed................: 0.00% ✓ 0 ✗ 475 http_req_receiving.............: avg=131.17µs min=63.62µs med=117.89µs max=679.63µs p(90)=171.52µs p(95)=192.99µs http_req_sending...............: avg=118.36µs min=9.01µs med=19.67µs max=1.15ms p(90)=242.1µs p(95)=935.8µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.16s min=3.48s med=7.41s max=8.9s p(90)=8.3s p(95)=8.47s http_reqs......................: 475 12.636324/s iteration_duration.............: avg=7.17s min=3.49s med=7.42s max=8.9s p(90)=8.31s p(95)=8.48s iterations.....................: 475 12.636324/s vus............................: 11 min=11 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 150 4605 total, 0 failed avg: 609ms, p95: 801ms
wundergraph 100 3082 total, 0 failed avg: 947ms, p95: 1183ms
mesh-supergraph-bun 83 2594 total, 0 failed avg: 1143ms, p95: 1737ms
cosmo 79 2497 total, 0 failed avg: 1194ms, p95: 1459ms
apollo-server 45 1437 total, 0 failed avg: 2136ms, p95: 2474ms
mesh-supergraph 30 976 total, 0 failed avg: 3178ms, p95: 5059ms
mercurius 12 456 total, 0 failed avg: 7474ms, p95: 8841ms
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13815 ✗ 0 data_received..................: 404 MB 13 MB/s data_sent......................: 5.5 MB 178 kB/s http_req_blocked...............: avg=69.61µs min=1.35µs med=2.7µs max=13.11ms p(90)=4.06µs p(95)=4.97µs http_req_connecting............: avg=58.88µs min=0s med=0s max=13.01ms p(90)=0s p(95)=0s http_req_duration..............: avg=608.65ms min=261.27ms med=600.04ms max=1.3s p(90)=742.4ms p(95)=801.23ms { expected_response:true }...: avg=608.65ms min=261.27ms med=600.04ms max=1.3s p(90)=742.4ms p(95)=801.23ms http_req_failed................: 0.00% ✓ 0 ✗ 4605 http_req_receiving.............: avg=8.94ms min=34.78µs med=67.45µs max=317.09ms p(90)=25.04ms p(95)=69.68ms http_req_sending...............: avg=1.05ms min=7.52µs med=13.05µs max=231.08ms p(90)=29.27µs p(95)=330µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=598.65ms min=261.15ms med=594.63ms max=1.13s p(90)=724.42ms p(95)=785.37ms http_reqs......................: 4605 150.013303/s iteration_duration.............: avg=657.92ms min=270.32ms med=640.42ms max=1.33s p(90)=822.83ms p(95)=909.04ms iterations.....................: 4605 150.013303/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9246 ✗ 0 data_received..................: 270 MB 8.8 MB/s data_sent......................: 3.7 MB 119 kB/s http_req_blocked...............: avg=101.22µs min=1.42µs med=3.12µs max=121.6ms p(90)=4.75µs p(95)=9.25µs http_req_connecting............: avg=52.24µs min=0s med=0s max=4.88ms p(90)=0s p(95)=0s http_req_duration..............: avg=947.44ms min=587.97ms med=928.68ms max=1.64s p(90)=1.1s p(95)=1.18s { expected_response:true }...: avg=947.44ms min=587.97ms med=928.68ms max=1.64s p(90)=1.1s p(95)=1.18s http_req_failed................: 0.00% ✓ 0 ✗ 3082 http_req_receiving.............: avg=10.41ms min=41.61µs med=99.43µs max=287.54ms p(90)=37.88ms p(95)=73.69ms http_req_sending...............: avg=1.44ms min=8.01µs med=14.59µs max=263.58ms p(90)=54.79µs p(95)=871.84µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=935.58ms min=587.89ms med=922.53ms max=1.35s p(90)=1.08s p(95)=1.16s http_reqs......................: 3082 100.469775/s iteration_duration.............: avg=987.97ms min=597.38ms med=962.99ms max=1.67s p(90)=1.17s p(95)=1.26s iterations.....................: 3082 100.469775/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7782 ✗ 0 data_received..................: 228 MB 7.3 MB/s data_sent......................: 3.1 MB 99 kB/s http_req_blocked...............: avg=69.78µs min=1.44µs med=2.98µs max=48.03ms p(90)=4.82µs p(95)=10.53µs http_req_connecting............: avg=34.11µs min=0s med=0s max=4.65ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.14s min=602ms med=1.09s max=3.36s p(90)=1.48s p(95)=1.73s { expected_response:true }...: avg=1.14s min=602ms med=1.09s max=3.36s p(90)=1.48s p(95)=1.73s http_req_failed................: 0.00% ✓ 0 ✗ 2594 http_req_receiving.............: avg=15.11ms min=36.28µs med=91.52µs max=577.71ms p(90)=4.54ms p(95)=45.07ms http_req_sending...............: avg=379.96µs min=8.12µs med=14.06µs max=88.28ms p(90)=48.8µs p(95)=259.06µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.12s min=601.64ms med=1.08s max=3.34s p(90)=1.43s p(95)=1.72s http_reqs......................: 2594 83.767819/s iteration_duration.............: avg=1.17s min=610.9ms med=1.11s max=3.52s p(90)=1.52s p(95)=1.78s iterations.....................: 2594 83.767819/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7491 ✗ 0 data_received..................: 219 MB 7.0 MB/s data_sent......................: 3.0 MB 95 kB/s http_req_blocked...............: avg=55.59µs min=1.28µs med=2.49µs max=4.69ms p(90)=3.97µs p(95)=8.56µs http_req_connecting............: avg=47.48µs min=0s med=0s max=3.38ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.19s min=794.9ms med=1.18s max=1.77s p(90)=1.37s p(95)=1.45s { expected_response:true }...: avg=1.19s min=794.9ms med=1.18s max=1.77s p(90)=1.37s p(95)=1.45s http_req_failed................: 0.00% ✓ 0 ✗ 2497 http_req_receiving.............: avg=7.78ms min=37.69µs med=76.32µs max=290.23ms p(90)=17.55ms p(95)=60.43ms http_req_sending...............: avg=1.5ms min=7.51µs med=12.52µs max=312.67ms p(90)=76.11µs p(95)=1ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.18s min=794.75ms med=1.17s max=1.63s p(90)=1.36s p(95)=1.44s http_reqs......................: 2497 79.902325/s iteration_duration.............: avg=1.22s min=805.95ms med=1.21s max=1.79s p(90)=1.41s p(95)=1.51s iterations.....................: 2497 79.902325/s vus............................: 44 min=44 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4311 ✗ 0 data_received..................: 126 MB 4.0 MB/s data_sent......................: 1.7 MB 54 kB/s http_req_blocked...............: avg=118.73µs min=1.56µs med=4.31µs max=4.14ms p(90)=6.02µs p(95)=642.24µs http_req_connecting............: avg=108.03µs min=0s med=0s max=4.11ms p(90)=0s p(95)=504.18µs http_req_duration..............: avg=2.13s min=903.34ms med=1.89s max=15.16s p(90)=2.33s p(95)=2.47s { expected_response:true }...: avg=2.13s min=903.34ms med=1.89s max=15.16s p(90)=2.33s p(95)=2.47s http_req_failed................: 0.00% ✓ 0 ✗ 1437 http_req_receiving.............: avg=201.39µs min=58.65µs med=134.3µs max=20.73ms p(90)=192.23µs p(95)=229.29µs http_req_sending...............: avg=72.59µs min=9.33µs med=24.44µs max=2.16ms p(90)=40.69µs p(95)=250.47µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.13s min=902.97ms med=1.89s max=15.16s p(90)=2.33s p(95)=2.47s http_reqs......................: 1437 45.812606/s iteration_duration.............: avg=2.14s min=910.56ms med=1.9s max=15.17s p(90)=2.35s p(95)=2.48s iterations.....................: 1437 45.812606/s vus............................: 44 min=44 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2928 ✗ 0 data_received..................: 86 MB 2.7 MB/s data_sent......................: 1.2 MB 36 kB/s http_req_blocked...............: avg=199.3µs min=1.35µs med=3.44µs max=8.75ms p(90)=126.86µs p(95)=1.44ms http_req_connecting............: avg=191.63µs min=0s med=0s max=8.72ms p(90)=72.93µs p(95)=1.4ms http_req_duration..............: avg=3.17s min=1.3s med=3.06s max=7.85s p(90)=4.37s p(95)=5.05s { expected_response:true }...: avg=3.17s min=1.3s med=3.06s max=7.85s p(90)=4.37s p(95)=5.05s http_req_failed................: 0.00% ✓ 0 ✗ 976 http_req_receiving.............: avg=2.42ms min=41.79µs med=159.57µs max=87.47ms p(90)=1.23ms p(95)=6.06ms http_req_sending...............: avg=294.83µs min=7.76µs med=18.73µs max=12.26ms p(90)=63.3µs p(95)=855.57µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.17s min=1.3s med=3.06s max=7.84s p(90)=4.37s p(95)=5.05s http_reqs......................: 976 30.597631/s iteration_duration.............: avg=3.19s min=1.31s med=3.07s max=7.88s p(90)=4.38s p(95)=5.07s iterations.....................: 976 30.597631/s vus............................: 67 min=67 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1368 ✗ 0 data_received..................: 40 MB 1.1 MB/s data_sent......................: 541 kB 14 kB/s http_req_blocked...............: avg=212.08µs min=1.47µs med=3.35µs max=3.27ms p(90)=780.7µs p(95)=1.54ms http_req_connecting............: avg=192.3µs min=0s med=0s max=3.23ms p(90)=706.08µs p(95)=1.48ms http_req_duration..............: avg=7.47s min=2.9s med=7.65s max=8.98s p(90)=8.72s p(95)=8.84s { expected_response:true }...: avg=7.47s min=2.9s med=7.65s max=8.98s p(90)=8.72s p(95)=8.84s http_req_failed................: 0.00% ✓ 0 ✗ 456 http_req_receiving.............: avg=134.98µs min=59.03µs med=121.74µs max=547.23µs p(90)=185.96µs p(95)=214.89µs http_req_sending...............: avg=96.3µs min=8.89µs med=20.35µs max=3.49ms p(90)=299.92µs p(95)=568.07µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.47s min=2.89s med=7.65s max=8.98s p(90)=8.72s p(95)=8.84s http_reqs......................: 456 12.129574/s iteration_duration.............: avg=7.48s min=2.9s med=7.65s max=8.99s p(90)=8.72s p(95)=8.84s iterations.....................: 456 12.129574/s vus............................: 13 min=13 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 175 5347 total, 0 failed avg: 492ms, p95: 674ms
apollo-router 165 5071 total, 0 failed avg: 549ms, p95: 734ms
wundergraph 157 4784 total, 0 failed avg: 532ms, p95: 954ms
mesh-supergraph-bun 65 2028 total, 0 failed avg: 1490ms, p95: 2578ms
apollo-server 48 1517 total, 0 failed avg: 2015ms, p95: 2678ms
mercurius 30 945 total, 0 failed avg: 3200ms, p95: 4284ms
mesh-supergraph 30 963 total, 0 failed avg: 3187ms, p95: 5178ms
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16041 ✗ 0 data_received..................: 469 MB 15 MB/s data_sent......................: 6.3 MB 208 kB/s http_req_blocked...............: avg=21.25µs min=1.19µs med=2.63µs max=3.12ms p(90)=3.82µs p(95)=4.96µs http_req_connecting............: avg=14.98µs min=0s med=0s max=2.7ms p(90)=0s p(95)=0s http_req_duration..............: avg=491.55ms min=21.44ms med=491.12ms max=1.57s p(90)=616.83ms p(95)=673.74ms { expected_response:true }...: avg=491.55ms min=21.44ms med=491.12ms max=1.57s p(90)=616.83ms p(95)=673.74ms http_req_failed................: 0.00% ✓ 0 ✗ 5347 http_req_receiving.............: avg=29.4ms min=37.95µs med=77.15µs max=1.42s p(90)=83.41ms p(95)=205.68ms http_req_sending...............: avg=1.46ms min=7.73µs med=12.92µs max=727.34ms p(90)=28.05µs p(95)=141.45µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=460.67ms min=21.38ms med=475.29ms max=783.15ms p(90)=573.62ms p(95)=607.2ms http_reqs......................: 5347 175.575982/s iteration_duration.............: avg=566.56ms min=33.22ms med=536.04ms max=2.38s p(90)=766.6ms p(95)=903.33ms iterations.....................: 5347 175.575982/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15213 ✗ 0 data_received..................: 445 MB 15 MB/s data_sent......................: 6.0 MB 197 kB/s http_req_blocked...............: avg=38.85µs min=1.38µs med=2.82µs max=24.37ms p(90)=4.22µs p(95)=5.24µs http_req_connecting............: avg=22.45µs min=0s med=0s max=4.29ms p(90)=0s p(95)=0s http_req_duration..............: avg=548.75ms min=239.81ms med=540.18ms max=1.31s p(90)=685.59ms p(95)=734.42ms { expected_response:true }...: avg=548.75ms min=239.81ms med=540.18ms max=1.31s p(90)=685.59ms p(95)=734.42ms http_req_failed................: 0.00% ✓ 0 ✗ 5071 http_req_receiving.............: avg=15.87ms min=36.3µs med=68.24µs max=787.15ms p(90)=37.35ms p(95)=98.24ms http_req_sending...............: avg=1.18ms min=7.72µs med=13.51µs max=691.96ms p(90)=37.3µs p(95)=148.64µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=531.69ms min=216.7ms med=530.28ms max=968.91ms p(90)=653.94ms p(95)=694.75ms http_reqs......................: 5071 165.7804/s iteration_duration.............: avg=598.22ms min=270.92ms med=579.9ms max=1.93s p(90)=751.87ms p(95)=838.89ms iterations.....................: 5071 165.7804/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14352 ✗ 0 data_received..................: 420 MB 14 MB/s data_sent......................: 5.7 MB 187 kB/s http_req_blocked...............: avg=188.99µs min=1µs med=2.73µs max=21.95ms p(90)=4.39µs p(95)=5.69µs http_req_connecting............: avg=176.01µs min=0s med=0s max=17.94ms p(90)=0s p(95)=0s http_req_duration..............: avg=532.27ms min=12.63ms med=505.6ms max=3.3s p(90)=819.26ms p(95)=954.21ms { expected_response:true }...: avg=532.27ms min=12.63ms med=505.6ms max=3.3s p(90)=819.26ms p(95)=954.21ms http_req_failed................: 0.00% ✓ 0 ✗ 4784 http_req_receiving.............: avg=48.02ms min=39.86µs med=84.32µs max=2.05s p(90)=135.04ms p(95)=313.1ms http_req_sending...............: avg=1.79ms min=7.55µs med=13.41µs max=831.45ms p(90)=33.25µs p(95)=338.71µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=482.45ms min=8.86ms med=468.76ms max=1.33s p(90)=757.94ms p(95)=855.9ms http_reqs......................: 4784 157.564927/s iteration_duration.............: avg=630.43ms min=25.09ms med=580.11ms max=3.69s p(90)=979.18ms p(95)=1.18s iterations.....................: 4784 157.564927/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 6084 ✗ 0 data_received..................: 178 MB 5.7 MB/s data_sent......................: 2.4 MB 77 kB/s http_req_blocked...............: avg=54.71µs min=1.55µs med=4.56µs max=14.75ms p(90)=8.67µs p(95)=102.12µs http_req_connecting............: avg=37.39µs min=0s med=0s max=2.17ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.49s min=477.3ms med=1.35s max=3.66s p(90)=2.21s p(95)=2.57s { expected_response:true }...: avg=1.49s min=477.3ms med=1.35s max=3.66s p(90)=2.21s p(95)=2.57s http_req_failed................: 0.00% ✓ 0 ✗ 2028 http_req_receiving.............: avg=19.88ms min=52.25µs med=186.41µs max=868.84ms p(90)=1.99ms p(95)=73.97ms http_req_sending...............: avg=303.32µs min=9.55µs med=21.63µs max=96.32ms p(90)=106.38µs p(95)=269.16µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.46s min=476.46ms med=1.34s max=3.66s p(90)=2.19s p(95)=2.57s http_reqs......................: 2028 65.158359/s iteration_duration.............: avg=1.51s min=488.51ms med=1.37s max=3.7s p(90)=2.24s p(95)=2.62s iterations.....................: 2028 65.158359/s vus............................: 12 min=12 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4551 ✗ 0 data_received..................: 133 MB 4.3 MB/s data_sent......................: 1.8 MB 57 kB/s http_req_blocked...............: avg=78.34µs min=1.43µs med=3.68µs max=7.28ms p(90)=5.56µs p(95)=164.36µs http_req_connecting............: avg=52.11µs min=0s med=0s max=3.06ms p(90)=0s p(95)=113.06µs http_req_duration..............: avg=2.01s min=494.16ms med=1.62s max=21.8s p(90)=2.2s p(95)=2.67s { expected_response:true }...: avg=2.01s min=494.16ms med=1.62s max=21.8s p(90)=2.2s p(95)=2.67s http_req_failed................: 0.00% ✓ 0 ✗ 1517 http_req_receiving.............: avg=236.55µs min=50.21µs med=123.32µs max=60.79ms p(90)=181.8µs p(95)=209.58µs http_req_sending...............: avg=64.3µs min=8.46µs med=18.8µs max=24.69ms p(90)=34.38µs p(95)=98.69µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.01s min=493.22ms med=1.62s max=21.8s p(90)=2.2s p(95)=2.67s http_reqs......................: 1517 48.369835/s iteration_duration.............: avg=2.02s min=503.8ms med=1.64s max=21.81s p(90)=2.21s p(95)=2.68s iterations.....................: 1517 48.369835/s vus............................: 31 min=31 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2835 ✗ 0 data_received..................: 83 MB 2.7 MB/s data_sent......................: 1.1 MB 37 kB/s http_req_blocked...............: avg=248.43µs min=1.38µs med=3.61µs max=8.05ms p(90)=113.68µs p(95)=2.17ms http_req_connecting............: avg=232.64µs min=0s med=0s max=5.65ms p(90)=76.06µs p(95)=2.14ms http_req_duration..............: avg=3.19s min=631.62ms med=2.99s max=6.99s p(90)=4.1s p(95)=4.28s { expected_response:true }...: avg=3.19s min=631.62ms med=2.99s max=6.99s p(90)=4.1s p(95)=4.28s http_req_failed................: 0.00% ✓ 0 ✗ 945 http_req_receiving.............: avg=219.12µs min=45.08µs med=120.83µs max=69.69ms p(90)=188.59µs p(95)=256.41µs http_req_sending...............: avg=47.47µs min=8.2µs med=20.56µs max=2.35ms p(90)=47.3µs p(95)=238.97µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.19s min=631.54ms med=2.99s max=6.99s p(90)=4.09s p(95)=4.28s http_reqs......................: 945 30.884547/s iteration_duration.............: avg=3.21s min=646.68ms med=3s max=7s p(90)=4.1s p(95)=4.29s iterations.....................: 945 30.884547/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2889 ✗ 0 data_received..................: 85 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=372µs min=1.31µs med=3.81µs max=18.02ms p(90)=160.3µs p(95)=2.52ms http_req_connecting............: avg=335.62µs min=0s med=0s max=17.98ms p(90)=90.15µs p(95)=2.14ms http_req_duration..............: avg=3.18s min=735.73ms med=2.99s max=7.35s p(90)=4.69s p(95)=5.17s { expected_response:true }...: avg=3.18s min=735.73ms med=2.99s max=7.35s p(90)=4.69s p(95)=5.17s http_req_failed................: 0.00% ✓ 0 ✗ 963 http_req_receiving.............: avg=3.9ms min=40.01µs med=155.93µs max=89.99ms p(90)=2.84ms p(95)=25.81ms http_req_sending...............: avg=399.85µs min=7.98µs med=20.93µs max=17.8ms p(90)=82.85µs p(95)=674.53µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.18s min=735.57ms med=2.99s max=7.35s p(90)=4.69s p(95)=5.17s http_reqs......................: 963 30.540547/s iteration_duration.............: avg=3.2s min=741.42ms med=3.01s max=7.37s p(90)=4.72s p(95)=5.18s iterations.....................: 963 30.540547/s vus............................: 47 min=47 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2079ms 175 12281 total, 0 failed avg: 710ms, p95: 2080ms, max: 6787ms, med: 506ms
apollo-router 2907ms 174 12200 total, 0 failed avg: 854ms, p95: 2908ms, max: 7319ms, med: 512ms
wundergraph 3206ms 164 11493 total, 0 failed avg: 882ms, p95: 3206ms, max: 8573ms, med: 509ms
mesh-supergraph-bun 5502ms 117 8195 total, 0 failed avg: 2232ms, p95: 5502ms, max: 9260ms, med: 1928ms
mesh-supergraph 6556ms 67 4711 total, 0 failed avg: 4051ms, p95: 6556ms, max: 8481ms, med: 4337ms
apollo-server 23842ms 68 5021 total, 0 failed avg: 4159ms, p95: 23843ms, max: 44992ms, med: 2195ms
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36843 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 208 kB/s http_req_blocked...............: avg=14.85ms min=1.18µs med=2.86µs max=2.65s p(90)=4.46µs p(95)=11.39µs http_req_connecting............: avg=14.65ms min=0s med=0s max=2.65s p(90)=0s p(95)=0s http_req_duration..............: avg=710.47ms min=6.68ms med=505.5ms max=6.78s p(90)=1.55s p(95)=2.07s { expected_response:true }...: avg=710.47ms min=6.68ms med=505.5ms max=6.78s p(90)=1.55s p(95)=2.07s http_req_failed................: 0.00% ✓ 0 ✗ 12281 http_req_receiving.............: avg=233.81ms min=27.46µs med=74.55µs max=5.43s p(90)=909.07ms p(95)=1.48s http_req_sending...............: avg=33.09ms min=6.58µs med=13.39µs max=5.52s p(90)=310.13µs p(95)=102.19ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=443.56ms min=6.6ms med=359.92ms max=2.95s p(90)=904.38ms p(95)=1.1s http_reqs......................: 12281 175.431523/s iteration_duration.............: avg=1.47s min=12.14ms med=1s max=14.73s p(90)=3.44s p(95)=4.31s iterations.....................: 12281 175.431523/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36600 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 207 kB/s http_req_blocked...............: avg=15.07ms min=1.49µs med=2.89µs max=4.09s p(90)=4.64µs p(95)=11.74µs http_req_connecting............: avg=14.64ms min=0s med=0s max=4.08s p(90)=0s p(95)=0s http_req_duration..............: avg=853.99ms min=5.76ms med=512.01ms max=7.31s p(90)=1.98s p(95)=2.9s { expected_response:true }...: avg=853.99ms min=5.76ms med=512.01ms max=7.31s p(90)=1.98s p(95)=2.9s http_req_failed................: 0.00% ✓ 0 ✗ 12200 http_req_receiving.............: avg=345.35ms min=32.09µs med=76.01µs max=6.53s p(90)=1.23s p(95)=2.16s http_req_sending...............: avg=31.85ms min=7.78µs med=13.83µs max=5.53s p(90)=264.76µs p(95)=56.86ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=476.77ms min=5.7ms med=392.82ms max=2.16s p(90)=960.91ms p(95)=1.15s http_reqs......................: 12200 174.202542/s iteration_duration.............: avg=1.51s min=11.81ms med=922.3ms max=11.44s p(90)=3.83s p(95)=4.87s iterations.....................: 12200 174.202542/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34479 ✗ 0 data_received..................: 1.0 GB 14 MB/s data_sent......................: 14 MB 195 kB/s http_req_blocked...............: avg=18.4ms min=1.66µs med=3.2µs max=7.13s p(90)=5.11µs p(95)=14.26µs http_req_connecting............: avg=17.34ms min=0s med=0s max=7.13s p(90)=0s p(95)=0s http_req_duration..............: avg=881.52ms min=8.07ms med=508.51ms max=8.57s p(90)=2.22s p(95)=3.2s { expected_response:true }...: avg=881.52ms min=8.07ms med=508.51ms max=8.57s p(90)=2.22s p(95)=3.2s http_req_failed................: 0.00% ✓ 0 ✗ 11493 http_req_receiving.............: avg=403.68ms min=32.6µs med=84.8µs max=7.85s p(90)=1.61s p(95)=2.54s http_req_sending...............: avg=47.74ms min=7.5µs med=14.58µs max=6.08s p(90)=2.17ms p(95)=94.9ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=430.08ms min=7.93ms med=360.04ms max=2.71s p(90)=886.19ms p(95)=1.01s http_reqs......................: 11493 164.174869/s iteration_duration.............: avg=1.61s min=16.77ms med=988.4ms max=16.8s p(90)=3.99s p(95)=4.94s iterations.....................: 11493 164.174869/s vus............................: 1 min=1 max=493 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24585 ✗ 0 data_received..................: 719 MB 10 MB/s data_sent......................: 9.7 MB 139 kB/s http_req_blocked...............: avg=1.85ms min=1.4µs med=3.13µs max=251.43ms p(90)=5.66µs p(95)=219.56µs http_req_connecting............: avg=1.82ms min=0s med=0s max=251.34ms p(90)=0s p(95)=150.31µs http_req_duration..............: avg=2.23s min=5.37ms med=1.92s max=9.25s p(90)=4.41s p(95)=5.5s { expected_response:true }...: avg=2.23s min=5.37ms med=1.92s max=9.25s p(90)=4.41s p(95)=5.5s http_req_failed................: 0.00% ✓ 0 ✗ 8195 http_req_receiving.............: avg=25.96ms min=38.84µs med=79.73µs max=1.42s p(90)=28.11ms p(95)=187.41ms http_req_sending...............: avg=3.01ms min=8.48µs med=14.75µs max=791.35ms p(90)=77.59µs p(95)=7.62ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.2s min=5.18ms med=1.88s max=9.08s p(90)=4.4s p(95)=5.42s http_reqs......................: 8195 117.058493/s iteration_duration.............: avg=2.3s min=11.65ms med=1.99s max=9.37s p(90)=4.51s p(95)=5.66s iterations.....................: 8195 117.058493/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14133 ✗ 0 data_received..................: 413 MB 5.9 MB/s data_sent......................: 5.6 MB 80 kB/s http_req_blocked...............: avg=636.45µs min=1.63µs med=4.33µs max=199.85ms p(90)=185.58µs p(95)=418.33µs http_req_connecting............: avg=596.65µs min=0s med=0s max=199.78ms p(90)=125.55µs p(95)=342.3µs http_req_duration..............: avg=4.05s min=10.48ms med=4.33s max=8.48s p(90)=6.2s p(95)=6.55s { expected_response:true }...: avg=4.05s min=10.48ms med=4.33s max=8.48s p(90)=6.2s p(95)=6.55s http_req_failed................: 0.00% ✓ 0 ✗ 4711 http_req_receiving.............: avg=2.57ms min=41.18µs med=108.49µs max=562.07ms p(90)=1.16ms p(95)=8.17ms http_req_sending...............: avg=634.99µs min=8.54µs med=22.64µs max=178.28ms p(90)=60.8µs p(95)=143.75µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.04s min=10.38ms med=4.33s max=8.48s p(90)=6.18s p(95)=6.55s http_reqs......................: 4711 67.293821/s iteration_duration.............: avg=4.08s min=16.27ms med=4.35s max=8.49s p(90)=6.26s p(95)=6.58s iterations.....................: 4711 67.293821/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15063 ✗ 0 data_received..................: 441 MB 6.0 MB/s data_sent......................: 6.0 MB 82 kB/s http_req_blocked...............: avg=87.3µs min=1.5µs med=3.23µs max=35.42ms p(90)=51.25µs p(95)=301.68µs http_req_connecting............: avg=74.86µs min=0s med=0s max=35.25ms p(90)=0s p(95)=228.99µs http_req_duration..............: avg=4.15s min=86.23ms med=2.19s max=44.99s p(90)=3.34s p(95)=23.84s { expected_response:true }...: avg=4.15s min=86.23ms med=2.19s max=44.99s p(90)=3.34s p(95)=23.84s http_req_failed................: 0.00% ✓ 0 ✗ 5021 http_req_receiving.............: avg=323.24µs min=47.58µs med=116.45µs max=135.21ms p(90)=175.82µs p(95)=215.15µs http_req_sending...............: avg=42.4µs min=8.27µs med=16.72µs max=22.69ms p(90)=41.34µs p(95)=60.44µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.15s min=86.14ms med=2.19s max=44.99s p(90)=3.34s p(95)=23.84s http_reqs......................: 5021 68.626005/s iteration_duration.............: avg=4.17s min=97.5ms med=2.2s max=45s p(90)=3.35s p(95)=23.85s iterations.....................: 5021 68.626005/s vus............................: 17 min=17 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview