Closed rahxephon89 closed 1 week ago
🚨 4 jobs on the last run were significantly faster/slower than expected
Job | Duration | vs 7d avg | Delta |
---|---|---|---|
rust-build-cached-packages | 8m | 5m | |
rust-lints | 10m | 6m | |
rust-targeted-unit-tests | 27m | 18m | |
cli-e2e-tests / run-cli-tests | 9m | 6m |
compat
on 01b24e7e3548382dd25440b39a0438a993387f12
==> ed53797ceed1c32dddfbf7451201464dbdececf8
realistic_env_max_load
on ed53797ceed1c32dddfbf7451201464dbdececf8
compat
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> ed53797ceed1c32dddfbf7451201464dbdececf8
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> ed53797ceed1c32dddfbf7451201464dbdececf8 (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 5692 txn/s, latency: 5360 ms, (p50: 4800 ms, p90: 9900 ms, p99: 16300 ms), latency samples: 250480
2. Upgrading first Validator to new version: ed53797ceed1c32dddfbf7451201464dbdececf8
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1738 txn/s, latency: 16499 ms, (p50: 19000 ms, p90: 23100 ms, p99: 23700 ms), latency samples: 92120
3. Upgrading rest of first batch to new version: ed53797ceed1c32dddfbf7451201464dbdececf8
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1871 txn/s, latency: 15586 ms, (p50: 19800 ms, p90: 21900 ms, p99: 22500 ms), latency samples: 91680
4. upgrading second batch to new version: ed53797ceed1c32dddfbf7451201464dbdececf8
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3063 txn/s, latency: 10329 ms, (p50: 11000 ms, p90: 12400 ms, p99: 12600 ms), latency samples: 122520
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> ed53797ceed1c32dddfbf7451201464dbdececf8 passed
Test Ok
realistic_env_max_load
success on ed53797ceed1c32dddfbf7451201464dbdececf8
two traffics test: inner traffic : committed: 8400 txn/s, latency: 4669 ms, (p50: 4500 ms, p90: 5400 ms, p99: 9900 ms), latency samples: 3628900
two traffics test : committed: 100 txn/s, latency: 1792 ms, (p50: 1800 ms, p90: 2000 ms, p99: 3100 ms), latency samples: 1780
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.206, avg: 0.202", "QsPosToProposal: max: 0.237, avg: 0.221", "ConsensusProposalToOrdered: max: 0.403, avg: 0.389", "ConsensusOrderedToCommit: max: 0.394, avg: 0.384", "ConsensusProposalToCommit: max: 0.783, avg: 0.773"]
Max round gap was 1 [limit 4] at version 1866048. Max no progress secs was 4.969013 [limit 15] at version 1866048.
Test Ok
realistic_env_max_load
on ed53797ceed1c32dddfbf7451201464dbdececf8
compat
on 01b24e7e3548382dd25440b39a0438a993387f12
==> ed53797ceed1c32dddfbf7451201464dbdececf8
compat
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> ed53797ceed1c32dddfbf7451201464dbdececf8
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> ed53797ceed1c32dddfbf7451201464dbdececf8 (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 6657 txn/s, latency: 4967 ms, (p50: 4800 ms, p90: 8400 ms, p99: 9900 ms), latency samples: 233000
2. Upgrading first Validator to new version: ed53797ceed1c32dddfbf7451201464dbdececf8
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1759 txn/s, latency: 16516 ms, (p50: 18100 ms, p90: 24200 ms, p99: 24400 ms), latency samples: 89740
3. Upgrading rest of first batch to new version: ed53797ceed1c32dddfbf7451201464dbdececf8
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1683 txn/s, latency: 16108 ms, (p50: 18700 ms, p90: 22400 ms, p99: 24100 ms), latency samples: 90920
4. upgrading second batch to new version: ed53797ceed1c32dddfbf7451201464dbdececf8
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3620 txn/s, latency: 8823 ms, (p50: 9600 ms, p90: 12600 ms, p99: 12700 ms), latency samples: 144820
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> ed53797ceed1c32dddfbf7451201464dbdececf8 passed
Test Ok
realistic_env_max_load
success on ed53797ceed1c32dddfbf7451201464dbdececf8
two traffics test: inner traffic : committed: 7977 txn/s, latency: 4910 ms, (p50: 4700 ms, p90: 5900 ms, p99: 10200 ms), latency samples: 3446180
two traffics test : committed: 100 txn/s, latency: 1929 ms, (p50: 1900 ms, p90: 2200 ms, p99: 4400 ms), latency samples: 1800
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.205, avg: 0.200", "QsPosToProposal: max: 0.239, avg: 0.226", "ConsensusProposalToOrdered: max: 0.450, avg: 0.398", "ConsensusOrderedToCommit: max: 0.385, avg: 0.370", "ConsensusProposalToCommit: max: 0.778, avg: 0.769"]
Max round gap was 1 [limit 4] at version 1699805. Max no progress secs was 4.336599 [limit 15] at version 1699805.
Test Ok
Description
This PR creates the release yaml file to enable the feature flag
REJECT_UNSTABLE_BYTECODE
.