Closed JoshLind closed 1 week ago
realistic_env_max_load
on adc0d2b532c8d08596c775efcada712111399a76
framework_upgrade
on 01b24e7e3548382dd25440b39a0438a993387f12
==> adc0d2b532c8d08596c775efcada712111399a76
compat
on 01b24e7e3548382dd25440b39a0438a993387f12
==> adc0d2b532c8d08596c775efcada712111399a76
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 57.6%. Comparing base (
a1822a4
) to head (adc0d2b
). Report is 4 commits behind head on main.
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
compat
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> adc0d2b532c8d08596c775efcada712111399a76
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> adc0d2b532c8d08596c775efcada712111399a76 (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 5421 txn/s, latency: 6088 ms, (p50: 5000 ms, p90: 8800 ms, p99: 16900 ms), latency samples: 189740
2. Upgrading first Validator to new version: adc0d2b532c8d08596c775efcada712111399a76
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1778 txn/s, latency: 16212 ms, (p50: 19400 ms, p90: 22300 ms, p99: 22900 ms), latency samples: 92460
3. Upgrading rest of first batch to new version: adc0d2b532c8d08596c775efcada712111399a76
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1701 txn/s, latency: 17209 ms, (p50: 17700 ms, p90: 23600 ms, p99: 24100 ms), latency samples: 86760
4. upgrading second batch to new version: adc0d2b532c8d08596c775efcada712111399a76
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3612 txn/s, latency: 8868 ms, (p50: 9600 ms, p90: 12600 ms, p99: 13000 ms), latency samples: 144480
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> adc0d2b532c8d08596c775efcada712111399a76 passed
Test Ok
realistic_env_max_load
success on adc0d2b532c8d08596c775efcada712111399a76
two traffics test: inner traffic : committed: 7783 txn/s, latency: 5034 ms, (p50: 4800 ms, p90: 5700 ms, p99: 10300 ms), latency samples: 3362460
two traffics test : committed: 100 txn/s, latency: 1806 ms, (p50: 1800 ms, p90: 2000 ms, p99: 2400 ms), latency samples: 1860
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.206, avg: 0.202", "QsPosToProposal: max: 0.240, avg: 0.225", "ConsensusProposalToOrdered: max: 0.429, avg: 0.403", "ConsensusOrderedToCommit: max: 0.372, avg: 0.361", "ConsensusProposalToCommit: max: 0.774, avg: 0.764"]
Max round gap was 1 [limit 4] at version 234988. Max no progress secs was 4.683945 [limit 15] at version 2659206.
Test Ok
framework_upgrade
success on 01b24e7e3548382dd25440b39a0438a993387f12
==> adc0d2b532c8d08596c775efcada712111399a76
Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> adc0d2b532c8d08596c775efcada712111399a76 (PR)
Upgrade the nodes to version: adc0d2b532c8d08596c775efcada712111399a76
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1250 txn/s, submitted: 1252 txn/s, failed submission: 2 txn/s, expired: 2 txn/s, latency: 2608 ms, (p50: 2100 ms, p90: 4500 ms, p99: 7300 ms), latency samples: 105040
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1140 txn/s, submitted: 1142 txn/s, failed submission: 1 txn/s, expired: 1 txn/s, latency: 2858 ms, (p50: 2100 ms, p90: 5400 ms, p99: 9300 ms), latency samples: 94700
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> adc0d2b532c8d08596c775efcada712111399a76 passed
Upgrade the remaining nodes to version: adc0d2b532c8d08596c775efcada712111399a76
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1162 txn/s, submitted: 1164 txn/s, failed submission: 1 txn/s, expired: 1 txn/s, latency: 2907 ms, (p50: 2200 ms, p90: 5400 ms, p99: 8100 ms), latency samples: 95340
Test Ok
⏱️ 6h 5m total CI duration on this PR
| Job | Cumulative Duration | Recent Runs | |---|---|---| | [forge-framework-upgrade-test / forge](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24694074739) | 1h 20m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24694074739) | | [rust-smoke-tests](https://github.com/aptos-labs/aptos-core/actions/runs/8989701954/job/24693377137) | 45m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701954/job/24693377137) | | [windows-build](https://github.com/aptos-labs/aptos-core/actions/runs/8989701951/job/24693352447) | 44m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701951/job/24693352447) | | [rust-move-unit-coverage](https://github.com/aptos-labs/aptos-core/actions/runs/8989664862/job/24693236224) | 24m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989664862/job/24693236224) | | [execution-performance / single-node-performance](https://github.com/aptos-labs/aptos-core/actions/runs/8989701950/job/24693815805) | 23m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701950/job/24693815805) | | [rust-targeted-unit-tests](https://github.com/aptos-labs/aptos-core/actions/runs/8989701954/job/24693376893) | 22m | [⬜](https://github.com/aptos-labs/aptos-core/actions/runs/8989664850/job/24693250690) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701954/job/24693376893) | | [rust-move-tests](https://github.com/aptos-labs/aptos-core/actions/runs/8989701953/job/24693366275) | 18m | [⬜](https://github.com/aptos-labs/aptos-core/actions/runs/8989664866/job/24693236501) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701953/job/24693366275) | | [rust-images / rust-all](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24693369642) | 18m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24693369642) | | [forge-e2e-test / forge](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24694074527) | 17m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24694074527) | | [forge-compat-test / forge](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24694074353) | 13m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24694074353) | | [execution-performance / test-target-determinator](https://github.com/aptos-labs/aptos-core/actions/runs/8989701950/job/24693352919) | 11m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701950/job/24693352919) | | [rust-lints](https://github.com/aptos-labs/aptos-core/actions/runs/8989701954/job/24693376493) | 11m | [⬜](https://github.com/aptos-labs/aptos-core/actions/runs/8989664850/job/24693250428) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701954/job/24693376493) | | [test-target-determinator](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24693363050) | 11m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24693363050) | | [cli-e2e-tests / run-cli-tests](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24694074120) | 6m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24694074120) | | [run-tests-main-branch](https://github.com/aptos-labs/aptos-core/actions/runs/8989701970/job/24693378006) | 5m | [⬜](https://github.com/aptos-labs/aptos-core/actions/runs/8989664858/job/24693255014) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701970/job/24693378006) | | [check](https://github.com/aptos-labs/aptos-core/actions/runs/8989701971/job/24693352946) | 4m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701971/job/24693352946) | | [rust-build-cached-packages](https://github.com/aptos-labs/aptos-core/actions/runs/8989701954/job/24693377712) | 4m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701954/job/24693377712) | | [general-lints](https://github.com/aptos-labs/aptos-core/actions/runs/8989701954/job/24693376238) | 4m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989664850/job/24693250184) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701954/job/24693376238) | | [check-dynamic-deps](https://github.com/aptos-labs/aptos-core/actions/runs/8989701962/job/24693352347) | 3m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989664857/job/24693235145) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701962/job/24693352347) | | [node-api-compatibility-tests / node-api-compatibility-tests](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24694073625) | 50s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24694073625) | | [semgrep/ci](https://github.com/aptos-labs/aptos-core/actions/runs/8989701956/job/24693352416) | 49s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989664848/job/24693235215) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701956/job/24693352416) | | [file_change_determinator](https://github.com/aptos-labs/aptos-core/actions/runs/8989701954/job/24693364092) | 22s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989664850/job/24693236521) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701954/job/24693364092) | | [file_change_determinator](https://github.com/aptos-labs/aptos-core/actions/runs/8989701970/job/24693365852) | 21s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989664858/job/24693244120) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701970/job/24693365852) | | [file_change_determinator](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24693362807) | 10s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24693362807) | | [permission-check](https://github.com/aptos-labs/aptos-core/actions/runs/8989702007/job/24693353286) | 8s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989664852/job/24693236318) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989702007/job/24693353286) | | [permission-check](https://github.com/aptos-labs/aptos-core/actions/runs/8989701970/job/24693357488) | 6s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989664858/job/24693236093) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701970/job/24693357488) | | [permission-check](https://github.com/aptos-labs/aptos-core/actions/runs/8989701967/job/24693352192) | 6s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989664869/job/24693235608) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701967/job/24693352192) | | [permission-check](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24693353310) | 4s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24693353310) | | [permission-check](https://github.com/aptos-labs/aptos-core/actions/runs/8989701976/job/24693352649) | 4s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989664845/job/24693235214) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989701976/job/24693352649) | | [determine-docker-build-metadata](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24693362505) | 2s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24693362505) |🚨 6 jobs on the last run were significantly faster/slower than expected
| Job | Duration | vs 7d avg | Delta | |---|---|---|---| | [rust-move-tests](https://github.com/aptos-labs/aptos-core/actions/runs/8989701953/job/24693366275) | 16m | [9m](https://app.trunk.io/aptoslabs/aptos-labs/aptos-core/ci-analytics/1_f5552b2e-3021-44f5-b126-675f2b4babfd/1_0cd7d25e-fcfb-4f91-92d7-744e64d9f8c2?timeBased=true&numericAggregateFunctions=NUMERIC_AGGREGATE_FUNCTION_AVG&timeRange=7+days&conclusion=GIT_HUB_REPO_ACTIVITY_RUN_CONCLUSION_SUCCESS&utm_source=gh-comment) | [![+88%](https://img.shields.io/badge/+88%25-A72218)](https://app.trunk.io/aptoslabs/aptos-labs/aptos-core/ci-analytics/1_f5552b2e-3021-44f5-b126-675f2b4babfd/1_0cd7d25e-fcfb-4f91-92d7-744e64d9f8c2?timeBased=true&numericAggregateFunctions=NUMERIC_AGGREGATE_FUNCTION_AVG&timeRange=7+days&conclusion=GIT_HUB_REPO_ACTIVITY_RUN_CONCLUSION_SUCCESS&utm_source=gh-comment) | | [rust-lints](https://github.com/aptos-labs/aptos-core/actions/runs/8989701954/job/24693376493) | 10m | [6m](https://app.trunk.io/aptoslabs/aptos-labs/aptos-core/ci-analytics/1_750a2cec-81f6-4bb8-9b9c-80b3f99f60f6/1_7d010dff-1df6-488e-9fc4-e06173c41ad7?timeBased=true&numericAggregateFunctions=NUMERIC_AGGREGATE_FUNCTION_AVG&timeRange=7+days&conclusion=GIT_HUB_REPO_ACTIVITY_RUN_CONCLUSION_SUCCESS&utm_source=gh-comment) | [![+66%](https://img.shields.io/badge/+66%25-A72218)](https://app.trunk.io/aptoslabs/aptos-labs/aptos-core/ci-analytics/1_750a2cec-81f6-4bb8-9b9c-80b3f99f60f6/1_7d010dff-1df6-488e-9fc4-e06173c41ad7?timeBased=true&numericAggregateFunctions=NUMERIC_AGGREGATE_FUNCTION_AVG&timeRange=7+days&conclusion=GIT_HUB_REPO_ACTIVITY_RUN_CONCLUSION_SUCCESS&utm_source=gh-comment) | | [rust-images / rust-all](https://github.com/aptos-labs/aptos-core/actions/runs/8989702041/job/24693369642) | 18m | [13m](https://app.trunk.io/aptoslabs/aptos-labs/aptos-core/ci-analytics/1_e2165897-506f-48cf-af00-df19955c86e6/1_a9d9fb68-fa86-4597-a953-ee0bdeb74a12?timeBased=true&numericAggregateFunctions=NUMERIC_AGGREGATE_FUNCTION_AVG&timeRange=7+days&conclusion=GIT_HUB_REPO_ACTIVITY_RUN_CONCLUSION_SUCCESS&utm_source=gh-comment) | [![+33%](https://img.shields.io/badge/+33%25-E87A30)](https://app.trunk.io/aptoslabs/aptos-labs/aptos-core/ci-analytics/1_e2165897-506f-48cf-af00-df19955c86e6/1_a9d9fb68-fa86-4597-a953-ee0bdeb74a12?timeBased=true&numericAggregateFunctions=NUMERIC_AGGREGATE_FUNCTION_AVG&timeRange=7+days&conclusion=GIT_HUB_REPO_ACTIVITY_RUN_CONCLUSION_SUCCESS&utm_source=gh-comment) | | [rust-smoke-tests](https://github.com/aptos-labs/aptos-core/actions/runs/8989701954/job/24693377137) | 45m | [34m](https://app.trunk.io/aptoslabs/aptos-labs/aptos-core/ci-analytics/1_750a2cec-81f6-4bb8-9b9c-80b3f99f60f6/1_ad14efd2-00c0-40e4-a0a9-55cb5505d815?timeBased=true&numericAggregateFunctions=NUMERIC_AGGREGATE_FUNCTION_AVG&timeRange=7+days&conclusion=GIT_HUB_REPO_ACTIVITY_RUN_CONCLUSION_SUCCESS&utm_source=gh-comment) | [![+33%](https://img.shields.io/badge/+33%25-E87A30)](https://app.trunk.io/aptoslabs/aptos-labs/aptos-core/ci-analytics/1_750a2cec-81f6-4bb8-9b9c-80b3f99f60f6/1_ad14efd2-00c0-40e4-a0a9-55cb5505d815?timeBased=true&numericAggregateFunctions=NUMERIC_AGGREGATE_FUNCTION_AVG&timeRange=7+days&conclusion=GIT_HUB_REPO_ACTIVITY_RUN_CONCLUSION_SUCCESS&utm_source=gh-comment) | | [windows-build](https://github.com/aptos-labs/aptos-core/actions/runs/8989701951/job/24693352447) | 44m | [36m](https://app.trunk.io/aptoslabs/aptos-labs/aptos-core/ci-analytics/1_edb1561d-147b-4be7-bb53-2cca3929a4c7/1_4be87afb-fd0e-469f-991b-d6b2e2cdcf38?timeBased=true&numericAggregateFunctions=NUMERIC_AGGREGATE_FUNCTION_AVG&timeRange=7+days&conclusion=GIT_HUB_REPO_ACTIVITY_RUN_CONCLUSION_SUCCESS&utm_source=gh-comment) | [![+25%](https://img.shields.io/badge/+25%25-E87A30)](https://app.trunk.io/aptoslabs/aptos-labs/aptos-core/ci-analytics/1_edb1561d-147b-4be7-bb53-2cca3929a4c7/1_4be87afb-fd0e-469f-991b-d6b2e2cdcf38?timeBased=true&numericAggregateFunctions=NUMERIC_AGGREGATE_FUNCTION_AVG&timeRange=7+days&conclusion=GIT_HUB_REPO_ACTIVITY_RUN_CONCLUSION_SUCCESS&utm_source=gh-comment) | | [rust-move-unit-coverage](https://github.com/aptos-labs/aptos-core/actions/runs/8989664862/job/24693236224) | 24m | [20m](https://app.trunk.io/aptoslabs/aptos-labs/aptos-core/ci-analytics/1_c2f739d4-c4fa-4bcc-9b9d-1fae35344c16/1_5c45cf10-845e-49a6-867a-3e74707ea09d?timeBased=true&numericAggregateFunctions=NUMERIC_AGGREGATE_FUNCTION_AVG&timeRange=7+days&conclusion=GIT_HUB_REPO_ACTIVITY_RUN_CONCLUSION_SUCCESS&utm_source=gh-comment) | [![+22%](https://img.shields.io/badge/+22%25-E87A30)](https://app.trunk.io/aptoslabs/aptos-labs/aptos-core/ci-analytics/1_c2f739d4-c4fa-4bcc-9b9d-1fae35344c16/1_5c45cf10-845e-49a6-867a-3e74707ea09d?timeBased=true&numericAggregateFunctions=NUMERIC_AGGREGATE_FUNCTION_AVG&timeRange=7+days&conclusion=GIT_HUB_REPO_ACTIVITY_RUN_CONCLUSION_SUCCESS&utm_source=gh-comment) |settings ⋅ feedback ⋅ docs ⋅ learn more about trunk.io