Closed JoshLind closed 2 weeks ago
🚨 5 jobs on the last run were significantly faster/slower than expected
Job | Duration | vs 7d avg | Delta |
---|---|---|---|
forge-compat-test / forge | 18m | 14m | |
rust-build-cached-packages | 4m | 5m | |
windows-build | 19m | 36m | |
rust-move-tests | 4m | 9m | |
rust-targeted-unit-tests | 3m | 16m |
realistic_env_max_load
on 58a19715cbe9a5067b0fa0151d129f73929e8a23
compat
on 01b24e7e3548382dd25440b39a0438a993387f12
==> 58a19715cbe9a5067b0fa0151d129f73929e8a23
realistic_env_max_load
success on 58a19715cbe9a5067b0fa0151d129f73929e8a23
two traffics test: inner traffic : committed: 7856 txn/s, latency: 4990 ms, (p50: 4800 ms, p90: 5800 ms, p99: 11700 ms), latency samples: 3394180
two traffics test : committed: 100 txn/s, latency: 1902 ms, (p50: 1900 ms, p90: 2100 ms, p99: 5400 ms), latency samples: 1800
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.211, avg: 0.205", "QsPosToProposal: max: 0.268, avg: 0.229", "ConsensusProposalToOrdered: max: 0.445, avg: 0.412", "ConsensusOrderedToCommit: max: 0.422, avg: 0.396", "ConsensusProposalToCommit: max: 0.828, avg: 0.808"]
Max round gap was 1 [limit 4] at version 1740039. Max no progress secs was 4.79396 [limit 15] at version 1740039.
Test Ok
compat
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> 58a19715cbe9a5067b0fa0151d129f73929e8a23
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 58a19715cbe9a5067b0fa0151d129f73929e8a23 (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 5459 txn/s, latency: 5555 ms, (p50: 4900 ms, p90: 9600 ms, p99: 11300 ms), latency samples: 234760
2. Upgrading first Validator to new version: 58a19715cbe9a5067b0fa0151d129f73929e8a23
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1670 txn/s, latency: 17127 ms, (p50: 19300 ms, p90: 22400 ms, p99: 22800 ms), latency samples: 86840
3. Upgrading rest of first batch to new version: 58a19715cbe9a5067b0fa0151d129f73929e8a23
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1237 txn/s, latency: 20792 ms, (p50: 25100 ms, p90: 29800 ms, p99: 30300 ms), latency samples: 73000
4. upgrading second batch to new version: 58a19715cbe9a5067b0fa0151d129f73929e8a23
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3523 txn/s, latency: 8858 ms, (p50: 9600 ms, p90: 12600 ms, p99: 13900 ms), latency samples: 144460
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 58a19715cbe9a5067b0fa0151d129f73929e8a23 passed
Test Ok
Description
This PR prevents the
rust-unit-tests
job from triggering on every PR. Running all rust unit tests is no longer required because it has been replaced by targeted unit tests instead.Note:
rust-unit-tests
job will only trigger: (i) using workflow dispatch; (ii) on a relevant branch push; or (iii) if theCICD:run-all-unit-tests
label is added to a PR. This is useful for us to be able to monitor the accuracy of the targeted unit tests job while it bakes, and help to detect any unwanted breakages.Testing Plan
Manual verification and existing test infrastructure.