Closed vineethk closed 2 weeks ago
🚨 4 jobs on the last run were significantly faster/slower than expected
Job | Duration | vs 7d avg | Delta |
---|---|---|---|
rust-lints | 10m | 6m | |
rust-build-cached-packages | 8m | 5m | |
cli-e2e-tests / run-cli-tests | 9m | 7m | |
windows-build | 42m | 35m |
realistic_env_max_load
on 5ae1a127f4044bea42c734c2b93b8d7339e55213
framework_upgrade
on 01b24e7e3548382dd25440b39a0438a993387f12
==> 5ae1a127f4044bea42c734c2b93b8d7339e55213
compat
on 01b24e7e3548382dd25440b39a0438a993387f12
==> 5ae1a127f4044bea42c734c2b93b8d7339e55213
compat
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> 5ae1a127f4044bea42c734c2b93b8d7339e55213
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 5ae1a127f4044bea42c734c2b93b8d7339e55213 (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 6245 txn/s, latency: 5052 ms, (p50: 4800 ms, p90: 9300 ms, p99: 10500 ms), latency samples: 237320
2. Upgrading first Validator to new version: 5ae1a127f4044bea42c734c2b93b8d7339e55213
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1707 txn/s, latency: 16240 ms, (p50: 19000 ms, p90: 23800 ms, p99: 25000 ms), latency samples: 92180
3. Upgrading rest of first batch to new version: 5ae1a127f4044bea42c734c2b93b8d7339e55213
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1344 txn/s, latency: 17661 ms, (p50: 19300 ms, p90: 24200 ms, p99: 30600 ms), latency samples: 80680
4. upgrading second batch to new version: 5ae1a127f4044bea42c734c2b93b8d7339e55213
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 2837 txn/s, latency: 11174 ms, (p50: 10000 ms, p90: 15300 ms, p99: 16800 ms), latency samples: 110660
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 5ae1a127f4044bea42c734c2b93b8d7339e55213 passed
Test Ok
realistic_env_max_load
success on 5ae1a127f4044bea42c734c2b93b8d7339e55213
two traffics test: inner traffic : committed: 7062 txn/s, latency: 5522 ms, (p50: 5400 ms, p90: 6900 ms, p99: 13600 ms), latency samples: 3065320
two traffics test : committed: 100 txn/s, latency: 1868 ms, (p50: 1800 ms, p90: 2100 ms, p99: 2500 ms), latency samples: 1780
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.205, avg: 0.201", "QsPosToProposal: max: 0.384, avg: 0.303", "ConsensusProposalToOrdered: max: 0.503, avg: 0.458", "ConsensusOrderedToCommit: max: 0.383, avg: 0.365", "ConsensusProposalToCommit: max: 0.864, avg: 0.823"]
Max round gap was 1 [limit 4] at version 1432275. Max no progress secs was 4.251217 [limit 15] at version 1432275.
Test Ok
framework_upgrade
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> 5ae1a127f4044bea42c734c2b93b8d7339e55213
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 5ae1a127f4044bea42c734c2b93b8d7339e55213 (PR)
Upgrade the nodes to version: 5ae1a127f4044bea42c734c2b93b8d7339e55213
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1276 txn/s, submitted: 1279 txn/s, failed submission: 2 txn/s, expired: 2 txn/s, latency: 2491 ms, (p50: 2100 ms, p90: 4200 ms, p99: 5400 ms), latency samples: 108500
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1267 txn/s, submitted: 1269 txn/s, failed submission: 2 txn/s, expired: 2 txn/s, latency: 2511 ms, (p50: 2100 ms, p90: 4200 ms, p99: 6800 ms), latency samples: 112780
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 5ae1a127f4044bea42c734c2b93b8d7339e55213 passed
Upgrade the remaining nodes to version: 5ae1a127f4044bea42c734c2b93b8d7339e55213
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 973 txn/s, submitted: 976 txn/s, failed submission: 2 txn/s, expired: 2 txn/s, latency: 3057 ms, (p50: 2400 ms, p90: 5400 ms, p99: 6900 ms), latency samples: 87600
Test Ok
Description
Version bump ahead of release. Please note that this PR will not be merged in until all the release-blocking PRs land on main (which should be fairly soon). Please do not auto-merge.
Type of Change
Which Components or Systems Does This Change Impact?
How Has This Been Tested?
n/a
Key Areas to Review
Is the version bump acceptable or do we bump it to 4.0.0? There was an unreleased breaking change that I am not sure whether it qualifies to move up major version (or if the minor version bump suffices).
Checklist