aptos-labs / aptos-core

Aptos is a layer 1 blockchain built to support the widespread use of blockchain through better technology and user experience.
https://aptosfoundation.org
Other
5.86k stars 3.54k forks source link

[Do not merge][For Framework Upgrade Test] Update release.yaml #13299

Closed junkil-park closed 1 week ago

junkil-park commented 2 weeks ago

Description

Type of Change

Which Components or Systems Does This Change Impact?

How Has This Been Tested?

Key Areas to Review

Checklist

trunk-io[bot] commented 2 weeks ago
⏱️ 4h 38m total CI duration on this PR | Job | Cumulative Duration | Recent Runs | |---|---|---| | [forge-framework-upgrade-test / forge](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25064311220) | 1h 17m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25064311220)  | | [execution-performance / single-node-performance](https://github.com/aptos-labs/aptos-core/actions/runs/9116056582/job/25063798050) | 49m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056571/job/25063798009) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056582/job/25063798050)  | | [rust-smoke-tests](https://github.com/aptos-labs/aptos-core/actions/runs/9116056552/job/25063803699) | 34m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056552/job/25063803699)  | | [rust-targeted-unit-tests](https://github.com/aptos-labs/aptos-core/actions/runs/9116056552/job/25063803481) | 24m | [⬜](https://github.com/aptos-labs/aptos-core/actions/runs/9116052421/job/25063781751) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056552/job/25063803481)  | | [forge-e2e-test / forge](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25064310986) | 15m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25064310986)  | | [forge-compat-test / forge](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25064311650) | 14m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25064311650)  | | [rust-images / rust-all](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25063804360) | 12m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25063804360)  | | [rust-move-tests](https://github.com/aptos-labs/aptos-core/actions/runs/9116056554/job/25063791496) | 11m | [⬜](https://github.com/aptos-labs/aptos-core/actions/runs/9116052423/job/25063770770) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056554/job/25063791496)  | | [cli-e2e-tests / run-cli-tests](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25064310784) | 9m | [🟥](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25064310784)  | | [rust-lints](https://github.com/aptos-labs/aptos-core/actions/runs/9116056552/job/25063802788) | 7m | [⬜](https://github.com/aptos-labs/aptos-core/actions/runs/9116052421/job/25063781318) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056552/job/25063802788)  | | [check-dynamic-deps](https://github.com/aptos-labs/aptos-core/actions/runs/9116056558/job/25063785930) | 5m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116052417/job/25063770021) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056537/job/25063785135) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056558/job/25063785930)  | | [rust-build-cached-packages](https://github.com/aptos-labs/aptos-core/actions/runs/9116056552/job/25063803904) | 5m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056552/job/25063803904)  | | [check](https://github.com/aptos-labs/aptos-core/actions/runs/9116056564/job/25063791567) | 4m | [⬜](https://github.com/aptos-labs/aptos-core/actions/runs/9116056538/job/25063786744) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056564/job/25063791567)  | | [run-tests-main-branch](https://github.com/aptos-labs/aptos-core/actions/runs/9116056614/job/25063808348) | 4m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056614/job/25063808348)  | | [indexer-grpc-e2e-tests / test-indexer-grpc-docker-compose](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25064310367) | 2m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25064310367)  | | [general-lints](https://github.com/aptos-labs/aptos-core/actions/runs/9116056552/job/25063803138) | 2m | [⬜](https://github.com/aptos-labs/aptos-core/actions/runs/9116052421/job/25063781552) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056552/job/25063803138)  | | [semgrep/ci](https://github.com/aptos-labs/aptos-core/actions/runs/9116056547/job/25063785773) | 1m | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116052418/job/25063769998) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056587/job/25063786461) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056547/job/25063785773)  | | [node-api-compatibility-tests / node-api-compatibility-tests](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25064310606) | 51s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25064310606)  | | [file_change_determinator](https://github.com/aptos-labs/aptos-core/actions/runs/9116056614/job/25063799167) | 22s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116052304/job/25063776747) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056614/job/25063799167)  | | [file_change_determinator](https://github.com/aptos-labs/aptos-core/actions/runs/9116056552/job/25063791884) | 19s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116052421/job/25063770742) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056552/job/25063791884)  | | [execution-performance / file_change_determinator](https://github.com/aptos-labs/aptos-core/actions/runs/9116056571/job/25063786975) | 18s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056582/job/25063787263) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056571/job/25063786975)  | | [file_change_determinator](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25063796862) | 12s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25063796862)  | | [permission-check](https://github.com/aptos-labs/aptos-core/actions/runs/9116056608/job/25063786594) | 8s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116052300/job/25063769422) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056596/job/25063786302) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056608/job/25063786594)  | | [permission-check](https://github.com/aptos-labs/aptos-core/actions/runs/9116056610/job/25063786606) | 7s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116052303/job/25063769567) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056611/job/25063786197) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056610/job/25063786606)  | | [permission-check](https://github.com/aptos-labs/aptos-core/actions/runs/9116056614/job/25063792068) | 5s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116052304/job/25063769821) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056614/job/25063792068)  | | [permission-check](https://github.com/aptos-labs/aptos-core/actions/runs/9116056594/job/25063788527) | 5s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116052301/job/25063769902) [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056594/job/25063788527)  | | [permission-check](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25063789176) | 4s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25063789176)  | | [determine-docker-build-metadata](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25063796588) | 3s | [🟩](https://github.com/aptos-labs/aptos-core/actions/runs/9116056706/job/25063796588)  |

🚨 2 jobs on the last run were significantly faster/slower than expected

Job Duration vs 7d avg Delta
cli-e2e-tests / run-cli-tests 9m 7m +38%
rust-targeted-unit-tests 24m 20m +24%

settingsfeedbackdocs ⋅ learn more about trunk.io

github-actions[bot] commented 2 weeks ago

Forge is running suite compat on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8

github-actions[bot] commented 2 weeks ago

Forge is running suite framework_upgrade on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8

github-actions[bot] commented 2 weeks ago

Forge is running suite realistic_env_max_load on 0a4009abef98a1c61e089fb01257c3b937c406a8

github-actions[bot] commented 2 weeks ago

:white_check_mark: Forge suite compat success on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8

Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8 (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 5651 txn/s, latency: 5652 ms, (p50: 4800 ms, p90: 9900 ms, p99: 11100 ms), latency samples: 237360
2. Upgrading first Validator to new version: 0a4009abef98a1c61e089fb01257c3b937c406a8
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1553 txn/s, latency: 18303 ms, (p50: 22700 ms, p90: 29200 ms, p99: 29900 ms), latency samples: 74560
3. Upgrading rest of first batch to new version: 0a4009abef98a1c61e089fb01257c3b937c406a8
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1609 txn/s, latency: 16874 ms, (p50: 19500 ms, p90: 22600 ms, p99: 24700 ms), latency samples: 86900
4. upgrading second batch to new version: 0a4009abef98a1c61e089fb01257c3b937c406a8
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3269 txn/s, latency: 9540 ms, (p50: 9900 ms, p90: 12500 ms, p99: 13900 ms), latency samples: 130780
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8 passed
Test Ok
github-actions[bot] commented 2 weeks ago

:white_check_mark: Forge suite realistic_env_max_load success on 0a4009abef98a1c61e089fb01257c3b937c406a8

two traffics test: inner traffic : committed: 7760 txn/s, latency: 5030 ms, (p50: 4800 ms, p90: 6000 ms, p99: 10200 ms), latency samples: 3367900
two traffics test : committed: 100 txn/s, latency: 1911 ms, (p50: 1800 ms, p90: 2100 ms, p99: 4400 ms), latency samples: 1840
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.208, avg: 0.202", "QsPosToProposal: max: 0.249, avg: 0.228", "ConsensusProposalToOrdered: max: 0.461, avg: 0.414", "ConsensusOrderedToCommit: max: 0.393, avg: 0.377", "ConsensusProposalToCommit: max: 0.805, avg: 0.791"]
Max round gap was 1 [limit 4] at version 1525615. Max no progress secs was 4.4573298 [limit 15] at version 1525615.
Test Ok
github-actions[bot] commented 2 weeks ago

:white_check_mark: Forge suite framework_upgrade success on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8

Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8 (PR)
Upgrade the nodes to version: 0a4009abef98a1c61e089fb01257c3b937c406a8
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1141 txn/s, submitted: 1143 txn/s, failed submission: 2 txn/s, expired: 2 txn/s, latency: 2722 ms, (p50: 2100 ms, p90: 4800 ms, p99: 7100 ms), latency samples: 102720
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1170 txn/s, submitted: 1173 txn/s, failed submission: 2 txn/s, expired: 2 txn/s, latency: 2722 ms, (p50: 2100 ms, p90: 4800 ms, p99: 8100 ms), latency samples: 106540
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 0a4009abef98a1c61e089fb01257c3b937c406a8 passed
Upgrade the remaining nodes to version: 0a4009abef98a1c61e089fb01257c3b937c406a8
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1214 txn/s, submitted: 1215 txn/s, failed submission: 1 txn/s, expired: 1 txn/s, latency: 2679 ms, (p50: 2100 ms, p90: 4800 ms, p99: 7400 ms), latency samples: 100780
Test Ok