search

the-guild-org / gateways-benchmark

MIT License
40 stars 7 forks source link

Update alpine Docker tag to v20240329 #428

Closed renovate[bot] closed 3 months ago

renovate[bot] commented 3 months ago

Mend Renovate

This PR contains the following updates:

Package Type Update Change
alpine final major 20240315 -> 20240329

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 3 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 175 5342 total, 0 failed avg: 497ms, p95: 694ms ✅
apollo-router 172 5233 total, 0 failed avg: 516ms, p95: 695ms ✅
wundergraph 153 4684 total, 0 failed avg: 546ms, p95: 1018ms ✅
mesh-supergraph-bun 94 2898 total, 0 failed avg: 1020ms, p95: 1731ms ✅
apollo-server 50 1582 total, 0 failed avg: 1949ms, p95: 2417ms ✅
mesh-supergraph 29 943 total, 0 failed avg: 3300ms, p95: 5165ms ✅
mercurius 27 850 total, 0 failed avg: 3576ms, p95: 5427ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16026 ✗ 0 data_received..................: 469 MB 15 MB/s data_sent......................: 6.3 MB 208 kB/s http_req_blocked...............: avg=39.57µs min=1.25µs med=2.6µs max=67.39ms p(90)=3.81µs p(95)=4.72µs http_req_connecting............: avg=15.89µs min=0s med=0s max=4.28ms p(90)=0s p(95)=0s http_req_duration..............: avg=497.29ms min=15.74ms med=492.73ms max=1.55s p(90)=621.54ms p(95)=693.73ms { expected_response:true }...: avg=497.29ms min=15.74ms med=492.73ms max=1.55s p(90)=621.54ms p(95)=693.73ms http_req_failed................: 0.00% ✓ 0 ✗ 5342 http_req_receiving.............: avg=29.95ms min=39.54µs med=73.91µs max=1.24s p(90)=67.65ms p(95)=213.17ms http_req_sending...............: avg=1.83ms min=7.66µs med=12.8µs max=850.89ms p(90)=37.46µs p(95)=460.77µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=465.5ms min=14.69ms med=478.59ms max=805.47ms p(90)=577.57ms p(95)=609.17ms http_reqs......................: 5342 175.397329/s iteration_duration.............: avg=567.63ms min=49.76ms med=535.8ms max=2.1s p(90)=773.44ms p(95)=922.2ms iterations.....................: 5342 175.397329/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15699 ✗ 0 data_received..................: 459 MB 15 MB/s data_sent......................: 6.2 MB 204 kB/s http_req_blocked...............: avg=78.11µs min=1.29µs med=2.72µs max=41.27ms p(90)=4.1µs p(95)=5.24µs http_req_connecting............: avg=60.26µs min=0s med=0s max=6.38ms p(90)=0s p(95)=0s http_req_duration..............: avg=516.08ms min=22.9ms med=516.58ms max=1.62s p(90)=648.04ms p(95)=695.27ms { expected_response:true }...: avg=516.08ms min=22.9ms med=516.58ms max=1.62s p(90)=648.04ms p(95)=695.27ms http_req_failed................: 0.00% ✓ 0 ✗ 5233 http_req_receiving.............: avg=19.09ms min=35.61µs med=66.86µs max=1.41s p(90)=32.94ms p(95)=97.99ms http_req_sending...............: avg=1.2ms min=7.83µs med=13.12µs max=918.89ms p(90)=32.49µs p(95)=145.15µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=495.78ms min=22.68ms med=506.72ms max=825.81ms p(90)=625.94ms p(95)=659.23ms http_reqs......................: 5233 172.002205/s iteration_duration.............: avg=577.41ms min=43.08ms med=559.75ms max=2.36s p(90)=732.75ms p(95)=830.1ms iterations.....................: 5233 172.002205/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14052 ✗ 0 data_received..................: 411 MB 14 MB/s data_sent......................: 5.6 MB 183 kB/s http_req_blocked...............: avg=93.03µs min=1.4µs med=3.24µs max=115.14ms p(90)=5.29µs p(95)=6.6µs http_req_connecting............: avg=39.65µs min=0s med=0s max=7.52ms p(90)=0s p(95)=0s http_req_duration..............: avg=545.55ms min=32.26ms med=509.59ms max=2.87s p(90)=893.8ms p(95)=1.01s { expected_response:true }...: avg=545.55ms min=32.26ms med=509.59ms max=2.87s p(90)=893.8ms p(95)=1.01s http_req_failed................: 0.00% ✓ 0 ✗ 4684 http_req_receiving.............: avg=62.12ms min=40.09µs med=105.87µs max=2.63s p(90)=172.13ms p(95)=396.26ms http_req_sending...............: avg=3.6ms min=8.11µs med=15.62µs max=1.3s p(90)=54.94µs p(95)=1.02ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=479.82ms min=24.64ms med=457.28ms max=1.27s p(90)=808.65ms p(95)=898.86ms http_reqs......................: 4684 153.868765/s iteration_duration.............: avg=645.56ms min=51.69ms med=583.23ms max=3.83s p(90)=1.05s p(95)=1.23s iterations.....................: 4684 153.868765/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8694 ✗ 0 data_received..................: 254 MB 8.3 MB/s data_sent......................: 3.4 MB 112 kB/s http_req_blocked...............: avg=34.33µs min=1.4µs med=3.21µs max=2.77ms p(90)=5.28µs p(95)=10.13µs http_req_connecting............: avg=27.96µs min=0s med=0s max=2.72ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.02s min=203.21ms med=880.09ms max=2.92s p(90)=1.62s p(95)=1.73s { expected_response:true }...: avg=1.02s min=203.21ms med=880.09ms max=2.92s p(90)=1.62s p(95)=1.73s http_req_failed................: 0.00% ✓ 0 ✗ 2898 http_req_receiving.............: avg=12.31ms min=39.46µs med=94.37µs max=532.74ms p(90)=2.55ms p(95)=70.47ms http_req_sending...............: avg=391.55µs min=7.89µs med=14.81µs max=208.87ms p(90)=37.46µs p(95)=149.86µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1s min=202.62ms med=873.23ms max=2.92s p(90)=1.62s p(95)=1.72s http_reqs......................: 2898 94.504742/s iteration_duration.............: avg=1.04s min=215.67ms med=903.96ms max=2.93s p(90)=1.65s p(95)=1.76s iterations.....................: 2898 94.504742/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4746 ✗ 0 data_received..................: 139 MB 4.4 MB/s data_sent......................: 1.9 MB 60 kB/s http_req_blocked...............: avg=95.37µs min=1.51µs med=3.05µs max=4.91ms p(90)=4.94µs p(95)=221.77µs http_req_connecting............: avg=89.84µs min=0s med=0s max=4.79ms p(90)=0s p(95)=191.15µs http_req_duration..............: avg=1.94s min=748.65ms med=1.61s max=20.88s p(90)=2.02s p(95)=2.41s { expected_response:true }...: avg=1.94s min=748.65ms med=1.61s max=20.88s p(90)=2.02s p(95)=2.41s http_req_failed................: 0.00% ✓ 0 ✗ 1582 http_req_receiving.............: avg=150.97µs min=46.6µs med=118.29µs max=17.69ms p(90)=176.12µs p(95)=201.31µs http_req_sending...............: avg=32.63µs min=8.35µs med=15.87µs max=2.75ms p(90)=30.14µs p(95)=97.07µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.94s min=748.52ms med=1.61s max=20.88s p(90)=2.02s p(95)=2.41s http_reqs......................: 1582 50.114107/s iteration_duration.............: avg=1.95s min=760.54ms med=1.62s max=20.89s p(90)=2.03s p(95)=2.42s iterations.....................: 1582 50.114107/s vus............................: 55 min=55 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2829 ✗ 0 data_received..................: 83 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=276.29µs min=1.48µs med=3.77µs max=5.34ms p(90)=482.88µs p(95)=2.55ms http_req_connecting............: avg=265.85µs min=0s med=0s max=5.29ms p(90)=458.32µs p(95)=2.48ms http_req_duration..............: avg=3.29s min=1.61s med=3.09s max=6.47s p(90)=4.65s p(95)=5.16s { expected_response:true }...: avg=3.29s min=1.61s med=3.09s max=6.47s p(90)=4.65s p(95)=5.16s http_req_failed................: 0.00% ✓ 0 ✗ 943 http_req_receiving.............: avg=3.18ms min=39.45µs med=166.57µs max=307.44ms p(90)=1.81ms p(95)=9.62ms http_req_sending...............: avg=69.82µs min=8.05µs med=19.97µs max=6.46ms p(90)=109.32µs p(95)=409.17µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.29s min=1.61s med=3.08s max=6.47s p(90)=4.65s p(95)=5.16s http_reqs......................: 943 29.385844/s iteration_duration.............: avg=3.31s min=1.61s med=3.1s max=6.48s p(90)=4.67s p(95)=5.18s iterations.....................: 943 29.385844/s vus............................: 10 min=10 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2550 ✗ 0 data_received..................: 75 MB 2.4 MB/s data_sent......................: 1.0 MB 33 kB/s http_req_blocked...............: avg=109.46µs min=1.74µs med=4.61µs max=2.99ms p(90)=133.06µs p(95)=842.94µs http_req_connecting............: avg=86.61µs min=0s med=0s max=2.45ms p(90)=98.21µs p(95)=707.09µs http_req_duration..............: avg=3.57s min=733.34ms med=3.33s max=8.42s p(90)=4.59s p(95)=5.42s { expected_response:true }...: avg=3.57s min=733.34ms med=3.33s max=8.42s p(90)=4.59s p(95)=5.42s http_req_failed................: 0.00% ✓ 0 ✗ 850 http_req_receiving.............: avg=352.67µs min=48.15µs med=124.25µs max=72.07ms p(90)=191µs p(95)=296.97µs http_req_sending...............: avg=76.34µs min=9.85µs med=27.76µs max=1.02ms p(90)=67.65µs p(95)=652.52µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.57s min=732.13ms med=3.33s max=8.42s p(90)=4.59s p(95)=5.42s http_reqs......................: 850 27.628467/s iteration_duration.............: avg=3.58s min=745.75ms med=3.34s max=8.43s p(90)=4.6s p(95)=5.43s iterations.....................: 850 27.628467/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 3 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 150 4591 total, 0 failed avg: 604ms, p95: 799ms ✅
wundergraph 100 3131 total, 0 failed avg: 940ms, p95: 1301ms ✅
mesh-supergraph-bun 80 2489 total, 0 failed avg: 1208ms, p95: 1883ms ✅
cosmo 78 2458 total, 0 failed avg: 1201ms, p95: 1433ms ✅
apollo-server 48 1523 total, 0 failed avg: 2016ms, p95: 2358ms ✅
mesh-supergraph 28 900 total, 0 failed avg: 3458ms, p95: 5602ms ✅
mercurius 11 449 total, 0 failed avg: 7577ms, p95: 9068ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13773 ✗ 0 data_received..................: 403 MB 13 MB/s data_sent......................: 5.4 MB 179 kB/s http_req_blocked...............: avg=77.08µs min=1.37µs med=2.69µs max=78.01ms p(90)=4.06µs p(95)=5.3µs http_req_connecting............: avg=48.2µs min=0s med=0s max=4.15ms p(90)=0s p(95)=0s http_req_duration..............: avg=604.07ms min=247.57ms med=594.01ms max=1.18s p(90)=745.24ms p(95)=799.3ms { expected_response:true }...: avg=604.07ms min=247.57ms med=594.01ms max=1.18s p(90)=745.24ms p(95)=799.3ms http_req_failed................: 0.00% ✓ 0 ✗ 4591 http_req_receiving.............: avg=14.5ms min=37.83µs med=68.48µs max=410.11ms p(90)=42.06ms p(95)=102.76ms http_req_sending...............: avg=1.12ms min=7.91µs med=12.98µs max=255.36ms p(90)=29.59µs p(95)=238.73µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=588.44ms min=247.34ms med=583.36ms max=933.9ms p(90)=716.32ms p(95)=757.73ms http_reqs......................: 4591 150.617155/s iteration_duration.............: avg=659.34ms min=257.64ms med=644.43ms max=1.28s p(90)=831.3ms p(95)=918.64ms iterations.....................: 4591 150.617155/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9393 ✗ 0 data_received..................: 275 MB 8.8 MB/s data_sent......................: 3.7 MB 120 kB/s http_req_blocked...............: avg=28.8µs min=1.09µs med=2.66µs max=32.03ms p(90)=4.23µs p(95)=9.43µs http_req_connecting............: avg=9.19µs min=0s med=0s max=890.08µs p(90)=0s p(95)=0s http_req_duration..............: avg=939.85ms min=515.18ms med=910.5ms max=1.8s p(90)=1.11s p(95)=1.3s { expected_response:true }...: avg=939.85ms min=515.18ms med=910.5ms max=1.8s p(90)=1.11s p(95)=1.3s http_req_failed................: 0.00% ✓ 0 ✗ 3131 http_req_receiving.............: avg=8.94ms min=39.01µs med=86.22µs max=313.14ms p(90)=24.67ms p(95)=59.99ms http_req_sending...............: avg=1.33ms min=8.05µs med=13.03µs max=176.54ms p(90)=50.13µs p(95)=240.87µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=929.57ms min=498.43ms med=903.61ms max=1.78s p(90)=1.1s p(95)=1.29s http_reqs......................: 3131 100.82799/s iteration_duration.............: avg=979.91ms min=525.29ms med=944.63ms max=1.9s p(90)=1.18s p(95)=1.4s iterations.....................: 3131 100.82799/s vus............................: 13 min=13 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7467 ✗ 0 data_received..................: 218 MB 7.0 MB/s data_sent......................: 3.0 MB 95 kB/s http_req_blocked...............: avg=156.68µs min=1.86µs med=4.03µs max=20.32ms p(90)=6.15µs p(95)=14.05µs http_req_connecting............: avg=130.64µs min=0s med=0s max=6.3ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.2s min=607.23ms med=1.15s max=2.39s p(90)=1.57s p(95)=1.88s { expected_response:true }...: avg=1.2s min=607.23ms med=1.15s max=2.39s p(90)=1.57s p(95)=1.88s http_req_failed................: 0.00% ✓ 0 ✗ 2489 http_req_receiving.............: avg=13.49ms min=39.36µs med=102.25µs max=634.46ms p(90)=1.58ms p(95)=42.94ms http_req_sending...............: avg=448.99µs min=8.5µs med=20.37µs max=102.88ms p(90)=59.76µs p(95)=320.46µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.19s min=606.93ms med=1.14s max=2.39s p(90)=1.53s p(95)=1.85s http_reqs......................: 2489 80.086343/s iteration_duration.............: avg=1.23s min=618.34ms med=1.18s max=2.42s p(90)=1.61s p(95)=1.93s iterations.....................: 2489 80.086343/s vus............................: 20 min=20 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7374 ✗ 0 data_received..................: 216 MB 6.9 MB/s data_sent......................: 2.9 MB 93 kB/s http_req_blocked...............: avg=244.56µs min=1.36µs med=2.69µs max=13.46ms p(90)=4.31µs p(95)=9.85µs http_req_connecting............: avg=232.15µs min=0s med=0s max=13.42ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.2s min=810.73ms med=1.19s max=1.7s p(90)=1.38s p(95)=1.43s { expected_response:true }...: avg=1.2s min=810.73ms med=1.19s max=1.7s p(90)=1.38s p(95)=1.43s http_req_failed................: 0.00% ✓ 0 ✗ 2458 http_req_receiving.............: avg=17.53ms min=36.98µs med=96.61µs max=370.23ms p(90)=62.4ms p(95)=115.61ms http_req_sending...............: avg=1.45ms min=8.01µs med=12.99µs max=182.35ms p(90)=43.18µs p(95)=3.5ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.18s min=810.67ms med=1.18s max=1.59s p(90)=1.34s p(95)=1.38s http_reqs......................: 2458 78.396208/s iteration_duration.............: avg=1.24s min=845.04ms med=1.23s max=1.81s p(90)=1.44s p(95)=1.51s iterations.....................: 2458 78.396208/s vus............................: 34 min=34 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4569 ✗ 0 data_received..................: 134 MB 4.3 MB/s data_sent......................: 1.8 MB 58 kB/s http_req_blocked...............: avg=40.31µs min=1.42µs med=3.15µs max=6.61ms p(90)=5.26µs p(95)=173.42µs http_req_connecting............: avg=31.02µs min=0s med=0s max=6.07ms p(90)=0s p(95)=129.83µs http_req_duration..............: avg=2.01s min=917.4ms med=1.81s max=14.09s p(90)=2.19s p(95)=2.35s { expected_response:true }...: avg=2.01s min=917.4ms med=1.81s max=14.09s p(90)=2.19s p(95)=2.35s http_req_failed................: 0.00% ✓ 0 ✗ 1523 http_req_receiving.............: avg=299.48µs min=47.31µs med=114.02µs max=43.36ms p(90)=179.55µs p(95)=232.25µs http_req_sending...............: avg=43.97µs min=8.73µs med=17.09µs max=8.16ms p(90)=36.18µs p(95)=120.41µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.01s min=917.28ms med=1.81s max=14.09s p(90)=2.19s p(95)=2.35s http_reqs......................: 1523 48.403241/s iteration_duration.............: avg=2.02s min=924.38ms med=1.83s max=14.09s p(90)=2.2s p(95)=2.37s iterations.....................: 1523 48.403241/s vus............................: 62 min=62 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2700 ✗ 0 data_received..................: 79 MB 2.5 MB/s data_sent......................: 1.1 MB 33 kB/s http_req_blocked...............: avg=109.5µs min=1.45µs med=4.07µs max=5.04ms p(90)=119.78µs p(95)=704.17µs http_req_connecting............: avg=81.52µs min=0s med=0s max=2.4ms p(90)=87.97µs p(95)=548.1µs http_req_duration..............: avg=3.45s min=1.56s med=3.37s max=7s p(90)=4.83s p(95)=5.6s { expected_response:true }...: avg=3.45s min=1.56s med=3.37s max=7s p(90)=4.83s p(95)=5.6s http_req_failed................: 0.00% ✓ 0 ✗ 900 http_req_receiving.............: avg=2.94ms min=40.89µs med=167.22µs max=101.1ms p(90)=1.86ms p(95)=12.26ms http_req_sending...............: avg=78.38µs min=8.63µs med=22.25µs max=4.36ms p(90)=92.2µs p(95)=469.89µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.45s min=1.56s med=3.36s max=7s p(90)=4.83s p(95)=5.58s http_reqs......................: 900 28.105701/s iteration_duration.............: avg=3.47s min=1.57s med=3.38s max=7.02s p(90)=4.84s p(95)=5.61s iterations.....................: 900 28.105701/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1347 ✗ 0 data_received..................: 39 MB 1.0 MB/s data_sent......................: 533 kB 14 kB/s http_req_blocked...............: avg=651.3µs min=1.76µs med=3.4µs max=6.8ms p(90)=2.58ms p(95)=4.86ms http_req_connecting............: avg=638.31µs min=0s med=0s max=6.7ms p(90)=2.55ms p(95)=4.83ms http_req_duration..............: avg=7.57s min=3.19s med=7.78s max=9.5s p(90)=8.97s p(95)=9.06s { expected_response:true }...: avg=7.57s min=3.19s med=7.78s max=9.5s p(90)=8.97s p(95)=9.06s http_req_failed................: 0.00% ✓ 0 ✗ 449 http_req_receiving.............: avg=126.58µs min=60.02µs med=116.37µs max=719.59µs p(90)=169.14µs p(95)=196.28µs http_req_sending...............: avg=88.76µs min=9.46µs med=18.63µs max=623.2µs p(90)=405.2µs p(95)=486.46µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.57s min=3.19s med=7.78s max=9.5s p(90)=8.97s p(95)=9.06s http_reqs......................: 449 11.938461/s iteration_duration.............: avg=7.58s min=3.19s med=7.79s max=9.51s p(90)=8.98s p(95)=9.07s iterations.....................: 449 11.938461/s vus............................: 13 min=13 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 3 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2266ms 169 11873 total, 0 failed avg: 749ms, p95: 2267ms, max: 6365ms, med: 492ms ✅
wundergraph 2594ms 168 11779 total, 0 failed avg: 842ms, p95: 2595ms, max: 8352ms, med: 605ms ✅
apollo-router 2712ms 173 12148 total, 0 failed avg: 811ms, p95: 2712ms, max: 7730ms, med: 479ms ✅
mesh-supergraph-bun 5834ms 113 7980 total, 0 failed avg: 2305ms, p95: 5834ms, max: 9536ms, med: 2107ms ✅
mesh-supergraph 6479ms 70 4923 total, 0 failed avg: 3856ms, p95: 6479ms, max: 8816ms, med: 3986ms ✅
apollo-server 23872ms 68 5010 total, 0 failed avg: 4170ms, p95: 23872ms, max: 45141ms, med: 2214ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35619 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 201 kB/s http_req_blocked...............: avg=16.5ms min=1.61µs med=3.22µs max=6.48s p(90)=5.25µs p(95)=13.48µs http_req_connecting............: avg=16.09ms min=0s med=0s max=6.48s p(90)=0s p(95)=0s http_req_duration..............: avg=749.29ms min=6.85ms med=492.1ms max=6.36s p(90)=1.72s p(95)=2.26s { expected_response:true }...: avg=749.29ms min=6.85ms med=492.1ms max=6.36s p(90)=1.72s p(95)=2.26s http_req_failed................: 0.00% ✓ 0 ✗ 11873 http_req_receiving.............: avg=306.32ms min=32.3µs med=88.99µs max=5.65s p(90)=1.17s p(95)=1.57s http_req_sending...............: avg=31.72ms min=8.13µs med=15.09µs max=4.28s p(90)=350.65µs p(95)=81.64ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=411.24ms min=6.75ms med=342.15ms max=2.26s p(90)=805.67ms p(95)=997.02ms http_reqs......................: 11873 169.586257/s iteration_duration.............: avg=1.54s min=12.53ms med=987.42ms max=11.52s p(90)=3.79s p(95)=4.8s iterations.....................: 11873 169.586257/s vus............................: 1 min=1 max=492 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35337 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 200 kB/s http_req_blocked...............: avg=23.89ms min=1.24µs med=2.94µs max=5.41s p(90)=4.56µs p(95)=13.86µs http_req_connecting............: avg=22.13ms min=0s med=0s max=5.16s p(90)=0s p(95)=0s http_req_duration..............: avg=842.28ms min=5.92ms med=604.61ms max=8.35s p(90)=1.91s p(95)=2.59s { expected_response:true }...: avg=842.28ms min=5.92ms med=604.61ms max=8.35s p(90)=1.91s p(95)=2.59s http_req_failed................: 0.00% ✓ 0 ✗ 11779 http_req_receiving.............: avg=281.27ms min=34.23µs med=77.13µs max=7.52s p(90)=1.08s p(95)=1.79s http_req_sending...............: avg=44.06ms min=7.84µs med=13.97µs max=5.12s p(90)=182.07µs p(95)=92.35ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=516.94ms min=5.82ms med=379.16ms max=3.23s p(90)=1.11s p(95)=1.36s http_reqs......................: 11779 168.250217/s iteration_duration.............: avg=1.6s min=11.39ms med=1.08s max=12.52s p(90)=3.8s p(95)=5.08s iterations.....................: 11779 168.250217/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36444 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 206 kB/s http_req_blocked...............: avg=14.26ms min=1.59µs med=3.11µs max=4.51s p(90)=5.13µs p(95)=12.68µs http_req_connecting............: avg=12.95ms min=0s med=0s max=3.77s p(90)=0s p(95)=0s http_req_duration..............: avg=810.59ms min=6.16ms med=479ms max=7.72s p(90)=2s p(95)=2.71s { expected_response:true }...: avg=810.59ms min=6.16ms med=479ms max=7.72s p(90)=2s p(95)=2.71s http_req_failed................: 0.00% ✓ 0 ✗ 12148 http_req_receiving.............: avg=343.05ms min=31.59µs med=84.73µs max=6.38s p(90)=1.32s p(95)=2.01s http_req_sending...............: avg=34.24ms min=7.79µs med=14.4µs max=4.39s p(90)=187.94µs p(95)=54.81ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=433.29ms min=6.09ms med=349.2ms max=2.05s p(90)=873.31ms p(95)=1.04s http_reqs......................: 12148 173.531739/s iteration_duration.............: avg=1.51s min=11.56ms med=929.19ms max=13.97s p(90)=3.73s p(95)=4.74s iterations.....................: 12148 173.531739/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 23940 ✗ 0 data_received..................: 700 MB 10 MB/s data_sent......................: 9.5 MB 135 kB/s http_req_blocked...............: avg=2.19ms min=1.48µs med=3.11µs max=464.26ms p(90)=5.62µs p(95)=237.57µs http_req_connecting............: avg=2.13ms min=0s med=0s max=464.2ms p(90)=0s p(95)=157.04µs http_req_duration..............: avg=2.3s min=5.99ms med=2.1s max=9.53s p(90)=4.16s p(95)=5.83s { expected_response:true }...: avg=2.3s min=5.99ms med=2.1s max=9.53s p(90)=4.16s p(95)=5.83s http_req_failed................: 0.00% ✓ 0 ✗ 7980 http_req_receiving.............: avg=23.44ms min=35.83µs med=77.08µs max=1.63s p(90)=3.56ms p(95)=134.05ms http_req_sending...............: avg=2.5ms min=8.32µs med=14.49µs max=486.19ms p(90)=76.29µs p(95)=7.57ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.27s min=5.77ms med=2.07s max=9.14s p(90)=4.14s p(95)=5.82s http_reqs......................: 7980 113.996485/s iteration_duration.............: avg=2.37s min=11.65ms med=2.18s max=9.65s p(90)=4.29s p(95)=5.92s iterations.....................: 7980 113.996485/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14769 ✗ 0 data_received..................: 432 MB 6.2 MB/s data_sent......................: 5.8 MB 84 kB/s http_req_blocked...............: avg=584.46µs min=1.33µs med=3.74µs max=215.08ms p(90)=122.99µs p(95)=416.09µs http_req_connecting............: avg=537.16µs min=0s med=0s max=176.86ms p(90)=73.56µs p(95)=347.3µs http_req_duration..............: avg=3.85s min=10.52ms med=3.98s max=8.81s p(90)=6.08s p(95)=6.47s { expected_response:true }...: avg=3.85s min=10.52ms med=3.98s max=8.81s p(90)=6.08s p(95)=6.47s http_req_failed................: 0.00% ✓ 0 ✗ 4923 http_req_receiving.............: avg=2.11ms min=35.52µs med=97.63µs max=604.69ms p(90)=814.03µs p(95)=8.08ms http_req_sending...............: avg=583.32µs min=7.6µs med=20.74µs max=137.1ms p(90)=51.27µs p(95)=134.69µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.85s min=10.4ms med=3.98s max=8.81s p(90)=6.08s p(95)=6.46s http_reqs......................: 4923 70.32305/s iteration_duration.............: avg=3.88s min=16.18ms med=4.02s max=8.82s p(90)=6.11s p(95)=6.52s iterations.....................: 4923 70.32305/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15030 ✗ 0 data_received..................: 440 MB 6.0 MB/s data_sent......................: 5.9 MB 81 kB/s http_req_blocked...............: avg=114.86µs min=1.36µs med=3.31µs max=56.39ms p(90)=43.9µs p(95)=297.69µs http_req_connecting............: avg=96.03µs min=0s med=0s max=56.31ms p(90)=0s p(95)=214.66µs http_req_duration..............: avg=4.16s min=77.01ms med=2.21s max=45.14s p(90)=3.23s p(95)=23.87s { expected_response:true }...: avg=4.16s min=77.01ms med=2.21s max=45.14s p(90)=3.23s p(95)=23.87s http_req_failed................: 0.00% ✓ 0 ✗ 5010 http_req_receiving.............: avg=356.22µs min=44.46µs med=118.6µs max=242.31ms p(90)=180.89µs p(95)=217.34µs http_req_sending...............: avg=63.69µs min=8.32µs med=16.66µs max=29.66ms p(90)=41.52µs p(95)=61.43µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.16s min=76.39ms med=2.21s max=45.14s p(90)=3.23s p(95)=23.87s http_reqs......................: 5010 68.48577/s iteration_duration.............: avg=4.18s min=101.84ms med=2.22s max=45.14s p(90)=3.24s p(95)=23.88s iterations.....................: 5010 68.48577/s vus............................: 17 min=17 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 3 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 163 4989 total, 0 failed avg: 540ms, p95: 724ms ✅
wundergraph 103 3219 total, 0 failed avg: 910ms, p95: 1136ms ✅
mesh-supergraph-bun 100 3070 total, 0 failed avg: 948ms, p95: 1340ms ✅
cosmo 80 2493 total, 0 failed avg: 1174ms, p95: 1447ms ✅
apollo-server 63 1987 total, 0 failed avg: 1538ms, p95: 1785ms ✅
mesh-supergraph 61 1887 total, 0 failed avg: 1597ms, p95: 2533ms ✅
mercurius 12 476 total, 0 failed avg: 7122ms, p95: 8453ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14967 ✗ 0 data_received..................: 438 MB 14 MB/s data_sent......................: 5.9 MB 194 kB/s http_req_blocked...............: avg=68.6µs min=1.79µs med=3.61µs max=63.57ms p(90)=5.67µs p(95)=6.65µs http_req_connecting............: avg=49.86µs min=0s med=0s max=5.27ms p(90)=0s p(95)=0s http_req_duration..............: avg=540.43ms min=294.53ms med=530.48ms max=1.27s p(90)=671.37ms p(95)=724.35ms { expected_response:true }...: avg=540.43ms min=294.53ms med=530.48ms max=1.27s p(90)=671.37ms p(95)=724.35ms http_req_failed................: 0.00% ✓ 0 ✗ 4989 http_req_receiving.............: avg=15.33ms min=35.57µs med=85.75µs max=631.07ms p(90)=57.19ms p(95)=108.75ms http_req_sending...............: avg=1.72ms min=9.08µs med=18.2µs max=372.88ms p(90)=77.23µs p(95)=425.93µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=523.37ms min=287.05ms med=517.98ms max=884.39ms p(90)=638.67ms p(95)=685.95ms http_reqs......................: 4989 163.81256/s iteration_duration.............: avg=606.4ms min=308.78ms med=585.88ms max=1.45s p(90)=777.13ms p(95)=857.5ms iterations.....................: 4989 163.81256/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9657 ✗ 0 data_received..................: 282 MB 9.1 MB/s data_sent......................: 3.8 MB 123 kB/s http_req_blocked...............: avg=64.04µs min=1.42µs med=2.74µs max=128.32ms p(90)=4.36µs p(95)=7.04µs http_req_connecting............: avg=16.67µs min=0s med=0s max=1.71ms p(90)=0s p(95)=0s http_req_duration..............: avg=909.61ms min=602.54ms med=899.04ms max=1.46s p(90)=1.07s p(95)=1.13s { expected_response:true }...: avg=909.61ms min=602.54ms med=899.04ms max=1.46s p(90)=1.07s p(95)=1.13s http_req_failed................: 0.00% ✓ 0 ✗ 3219 http_req_receiving.............: avg=10.7ms min=39.77µs med=86.1µs max=414.42ms p(90)=29.28ms p(95)=67.11ms http_req_sending...............: avg=1.2ms min=8.11µs med=13.14µs max=215.26ms p(90)=37.74µs p(95)=247.29µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=897.71ms min=590.42ms med=892.05ms max=1.34s p(90)=1.05s p(95)=1.11s http_reqs......................: 3219 103.978542/s iteration_duration.............: avg=946.45ms min=632.59ms med=929.91ms max=1.49s p(90)=1.13s p(95)=1.2s iterations.....................: 3219 103.978542/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9210 ✗ 0 data_received..................: 269 MB 8.8 MB/s data_sent......................: 3.6 MB 119 kB/s http_req_blocked...............: avg=24.71µs min=1.54µs med=2.98µs max=4.8ms p(90)=4.57µs p(95)=9.81µs http_req_connecting............: avg=16.6µs min=0s med=0s max=1.43ms p(90)=0s p(95)=0s http_req_duration..............: avg=948.44ms min=389.77ms med=926.53ms max=2.03s p(90)=1.24s p(95)=1.34s { expected_response:true }...: avg=948.44ms min=389.77ms med=926.53ms max=2.03s p(90)=1.24s p(95)=1.34s http_req_failed................: 0.00% ✓ 0 ✗ 3070 http_req_receiving.............: avg=12.97ms min=38.4µs med=85.9µs max=761.16ms p(90)=2.06ms p(95)=75.24ms http_req_sending...............: avg=603.03µs min=8.99µs med=14.48µs max=258.95ms p(90)=37.7µs p(95)=262.93µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=934.86ms min=389.44ms med=915.42ms max=1.89s p(90)=1.21s p(95)=1.3s http_reqs......................: 3070 100.531458/s iteration_duration.............: avg=987.33ms min=397.6ms med=962.76ms max=2.28s p(90)=1.3s p(95)=1.41s iterations.....................: 3070 100.531458/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7479 ✗ 0 data_received..................: 219 MB 7.1 MB/s data_sent......................: 3.0 MB 96 kB/s http_req_blocked...............: avg=111.09µs min=1.64µs med=3.45µs max=6.06ms p(90)=5.93µs p(95)=14.06µs http_req_connecting............: avg=99.39µs min=0s med=0s max=5.08ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.17s min=665.93ms med=1.16s max=1.72s p(90)=1.38s p(95)=1.44s { expected_response:true }...: avg=1.17s min=665.93ms med=1.16s max=1.72s p(90)=1.38s p(95)=1.44s http_req_failed................: 0.00% ✓ 0 ✗ 2493 http_req_receiving.............: avg=14.2ms min=44.2µs med=126.78µs max=319.62ms p(90)=56.22ms p(95)=97.26ms http_req_sending...............: avg=1.67ms min=8.49µs med=16.48µs max=209.15ms p(90)=55.19µs p(95)=572.9µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.15s min=665.85ms med=1.15s max=1.69s p(90)=1.35s p(95)=1.4s http_reqs......................: 2493 80.607539/s iteration_duration.............: avg=1.21s min=679.12ms med=1.21s max=1.77s p(90)=1.43s p(95)=1.52s iterations.....................: 2493 80.607539/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5961 ✗ 0 data_received..................: 175 MB 5.6 MB/s data_sent......................: 2.4 MB 76 kB/s http_req_blocked...............: avg=34.49µs min=1.87µs med=4.03µs max=8.09ms p(90)=5.84µs p(95)=103.59µs http_req_connecting............: avg=19.66µs min=0s med=0s max=2.04ms p(90)=0s p(95)=38.27µs http_req_duration..............: avg=1.53s min=714.15ms med=1.46s max=10.25s p(90)=1.69s p(95)=1.78s { expected_response:true }...: avg=1.53s min=714.15ms med=1.46s max=10.25s p(90)=1.69s p(95)=1.78s http_req_failed................: 0.00% ✓ 0 ✗ 1987 http_req_receiving.............: avg=204.1µs min=49.56µs med=121.65µs max=35.96ms p(90)=180.34µs p(95)=215.53µs http_req_sending...............: avg=41.66µs min=9.98µs med=21.66µs max=4.55ms p(90)=36.98µs p(95)=56.02µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.53s min=713.95ms med=1.46s max=10.25s p(90)=1.69s p(95)=1.78s http_reqs......................: 1987 63.760841/s iteration_duration.............: avg=1.54s min=724.92ms med=1.47s max=10.25s p(90)=1.71s p(95)=1.79s iterations.....................: 1987 63.760841/s vus............................: 34 min=34 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5661 ✗ 0 data_received..................: 166 MB 5.4 MB/s data_sent......................: 2.2 MB 72 kB/s http_req_blocked...............: avg=62.44µs min=1.73µs med=3.95µs max=6.11ms p(90)=5.76µs p(95)=124.11µs http_req_connecting............: avg=49µs min=0s med=0s max=6.07ms p(90)=0s p(95)=83.95µs http_req_duration..............: avg=1.59s min=660.77ms med=1.43s max=4.36s p(90)=2.24s p(95)=2.53s { expected_response:true }...: avg=1.59s min=660.77ms med=1.43s max=4.36s p(90)=2.24s p(95)=2.53s http_req_failed................: 0.00% ✓ 0 ✗ 1887 http_req_receiving.............: avg=1.9ms min=39.79µs med=119.4µs max=290.02ms p(90)=2.44ms p(95)=9.2ms http_req_sending...............: avg=165.89µs min=8.39µs med=21.61µs max=54.85ms p(90)=42.09µs p(95)=133.75µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.59s min=660.69ms med=1.43s max=4.36s p(90)=2.24s p(95)=2.53s http_reqs......................: 1887 61.010532/s iteration_duration.............: avg=1.61s min=697.24ms med=1.46s max=4.38s p(90)=2.27s p(95)=2.54s iterations.....................: 1887 61.010532/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1428 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 565 kB 15 kB/s http_req_blocked...............: avg=392.43µs min=1.69µs med=4.09µs max=6.59ms p(90)=1.16ms p(95)=2.91ms http_req_connecting............: avg=374.1µs min=0s med=0s max=6.44ms p(90)=1.11ms p(95)=2.72ms http_req_duration..............: avg=7.12s min=3.2s med=7.42s max=8.69s p(90)=8.22s p(95)=8.45s { expected_response:true }...: avg=7.12s min=3.2s med=7.42s max=8.69s p(90)=8.22s p(95)=8.45s http_req_failed................: 0.00% ✓ 0 ✗ 476 http_req_receiving.............: avg=140.52µs min=63.44µs med=126.04µs max=515.42µs p(90)=196.73µs p(95)=231.15µs http_req_sending...............: avg=186.25µs min=9.32µs med=21.81µs max=1.49ms p(90)=1.07ms p(95)=1.3ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.12s min=3.2s med=7.42s max=8.69s p(90)=8.22s p(95)=8.45s http_reqs......................: 476 12.716257/s iteration_duration.............: avg=7.12s min=3.2s med=7.43s max=8.7s p(90)=8.23s p(95)=8.46s iterations.....................: 476 12.716257/s vus............................: 10 min=10 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview