Closed mxinden closed 2 weeks ago
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 95.33%. Comparing base (
dc068f9
) to head (5ef8c35
). Report is 1 commits behind head on main.
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
QUIC Interop Runner, client vs. server
QUIC Interop Runner, client vs. server
QUIC Interop Runner, client vs. server
Performance differences relative to dc068f9946122462e6b867b12ff3067e659b0ac6.
time: [99.311 ns 99.669 ns 100.01 ns] change: [-0.0350% +0.5401% +1.3386%] (p = 0.12 > 0.05) Found 6 outliers among 100 measurements (6.00%) 3 (3.00%) high mild 3 (3.00%) high severe
time: [117.13 ns 117.49 ns 117.88 ns] change: [-0.4170% +0.0020% +0.3811%] (p = 0.99 > 0.05) Found 15 outliers among 100 measurements (15.00%) 2 (2.00%) low mild 13 (13.00%) high severe
time: [116.66 ns 117.10 ns 117.64 ns] change: [-0.2337% +0.1937% +0.6125%] (p = 0.44 > 0.05) Found 9 outliers among 100 measurements (9.00%) 3 (3.00%) low severe 6 (6.00%) high severe
time: [97.192 ns 97.359 ns 97.550 ns] change: [-0.7181% +0.3101% +1.3862%] (p = 0.59 > 0.05) Found 8 outliers among 100 measurements (8.00%) 2 (2.00%) high mild 6 (6.00%) high severe
time: [111.44 ms 111.49 ms 111.54 ms] change: [-1.0347% -0.8412% -0.7121%] (p = 0.00 < 0.05) Found 3 outliers among 100 measurements (3.00%) 3 (3.00%) low mild
time: [25.621 ms 26.526 ms 27.420 ms] change: [-6.8554% -2.0021% +3.2220%] (p = 0.43 > 0.05)
time: [35.423 ms 36.917 ms 38.404 ms] change: [-1.1820% +5.2043% +12.100%] (p = 0.11 > 0.05)
time: [31.527 ms 32.248 ms 32.961 ms] change: [-3.4143% -0.1714% +3.1206%] (p = 0.92 > 0.05)
time: [44.187 ms 47.010 ms 49.831 ms] change: [-7.4945% +0.8653% +10.238%] (p = 0.84 > 0.05)
time: [113.20 ms 113.71 ms 114.19 ms] thrpt: [875.76 MiB/s 879.44 MiB/s 883.39 MiB/s] change: time: [-0.7771% -0.2463% +0.2427%] (p = 0.36 > 0.05) thrpt: [-0.2421% +0.2469% +0.7832%] Found 5 outliers among 100 measurements (5.00%) 2 (2.00%) low severe 2 (2.00%) low mild 1 (1.00%) high mild
time: [309.73 ms 313.85 ms 318.01 ms] thrpt: [31.446 Kelem/s 31.863 Kelem/s 32.286 Kelem/s] change: time: [-2.0982% -0.3087% +1.5368%] (p = 0.74 > 0.05) thrpt: [-1.5136% +0.3096% +2.1431%]
time: [33.933 ms 34.160 ms 34.406 ms] thrpt: [29.065 elem/s 29.274 elem/s 29.470 elem/s] change: time: [-0.1074% +0.7713% +1.7281%] (p = 0.10 > 0.05) thrpt: [-1.6987% -0.7654% +0.1075%] Found 8 outliers among 100 measurements (8.00%) 4 (4.00%) high mild 4 (4.00%) high severe
Transfer of 33554432 bytes over loopback. | Client | Server | CC | Pacing | Mean [ms] | Min [ms] | Max [ms] | Relative |
---|---|---|---|---|---|---|---|---|
msquic | msquic | 184.3 ± 96.3 | 90.9 | 349.5 | 1.00 | |||
neqo | msquic | reno | on | 301.2 ± 96.3 | 214.1 | 472.5 | 1.00 | |
neqo | msquic | reno | 244.4 ± 55.1 | 218.3 | 415.4 | 1.00 | ||
neqo | msquic | cubic | on | 218.8 ± 19.1 | 203.4 | 265.0 | 1.00 | |
neqo | msquic | cubic | 233.5 ± 32.3 | 204.2 | 313.6 | 1.00 | ||
msquic | neqo | reno | on | 179.7 ± 130.9 | 82.1 | 476.7 | 1.00 | |
msquic | neqo | reno | 127.4 ± 78.2 | 82.8 | 340.8 | 1.00 | ||
msquic | neqo | cubic | on | 140.1 ± 80.5 | 81.6 | 349.0 | 1.00 | |
msquic | neqo | cubic | 143.5 ± 88.6 | 81.4 | 324.3 | 1.00 | ||
neqo | neqo | reno | on | 184.2 ± 80.5 | 128.4 | 361.3 | 1.00 | |
neqo | neqo | reno | 231.4 ± 108.1 | 132.3 | 447.0 | 1.00 | ||
neqo | neqo | cubic | on | 229.3 ± 135.0 | 126.9 | 594.4 | 1.00 | |
neqo | neqo | cubic | 202.7 ± 81.1 | 123.5 | 361.9 | 1.00 |
Needed for https://github.com/mozilla/mtu/pull/21.