[Release-7.3] Cherry-pick Enable Accumulative Checksum in MutationRef (#11225)

[kakaiu]

Cherry-pick ACS Index (PR https://github.com/apple/foundationdb/pull/11225) to release-7.3 to guarantee the downgrade compatibility from 7.4, similar to MutationChecksum feature.

Feature on: 20240405-003157-zhewang-23b09646a07dc913 compressed=True data_size=34888425 duration=4969776 ended=100000 fail_fast=10 max_runs=100000 pass=100000 priority=100 remaining=0 runtime=1:29:34 sanity=False started=100000 stopped=20240405-020131 submitted=20240405-003157 timeout=5400 username=zhewang

Feature off: 20240405-003006-zhewang-ada6b9ade0623502 compressed=True data_size=34888438 duration=5580015 ended=100000 fail=2 fail_fast=10 max_runs=100000 pass=99998 priority=100 remaining=0 runtime=1:34:46 sanity=False started=100000 stopped=20240405-020452 submitted=20240405-003006 timeout=5400 username=zhewang

Code-Reviewer Section

The general pull request guidelines can be found here.

Please check each of the following things and check all boxes before accepting a PR.

• [ ] The PR has a description, explaining both the problem and the solution.
• [ ] The description mentions which forms of testing were done and the testing seems reasonable.
• [ ] Every function/class/actor that was touched is reasonably well documented.

For Release-Branches

If this PR is made against a release-branch, please also check the following:

• [ ] This change/bugfix is a cherry-pick from the next younger branch (younger release-branch or main if this is the youngest branch)
• [ ] There is a good reason why this PR needs to go into a release branch and this reason is documented (either in the description above or in a linked GitHub issue)

[foundationdb-ci]

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

• Commit ID: 14ee3a1663be36d3ceaf30f8e22d1133129e8701
• Duration 0:31:44
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-macos on macOS Ventura 13.x

• Commit ID: 14ee3a1663be36d3ceaf30f8e22d1133129e8701
• Duration 0:44:11
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

• Commit ID: 14ee3a1663be36d3ceaf30f8e22d1133129e8701
• Duration 0:49:15
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)
• Cluster Test Logs zip file of the test logs (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-clang on Linux CentOS 7

• Commit ID: 14ee3a1663be36d3ceaf30f8e22d1133129e8701
• Duration 1:01:02
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr on Linux CentOS 7

• Commit ID: 14ee3a1663be36d3ceaf30f8e22d1133129e8701
• Duration 1:02:03
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

• Commit ID: a91fd60e6b14d15aa20dcdb4445b01bf136f1987
• Duration 0:31:46
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-macos on macOS Ventura 13.x

• Commit ID: a91fd60e6b14d15aa20dcdb4445b01bf136f1987
• Duration 0:44:01
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

• Commit ID: a91fd60e6b14d15aa20dcdb4445b01bf136f1987
• Duration 0:48:56
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)
• Cluster Test Logs zip file of the test logs (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-clang on Linux CentOS 7

• Commit ID: a91fd60e6b14d15aa20dcdb4445b01bf136f1987
• Duration 1:00:20
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr on Linux CentOS 7

• Commit ID: a91fd60e6b14d15aa20dcdb4445b01bf136f1987
• Duration 1:04:16
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

• Commit ID: 13b6a6d33bf2ec7d6ff0a3b78967343000cfb15a
• Duration 0:32:10
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

• Commit ID: cc536becf2a2d5ad435b7a862d1959f780f0b8d5
• Duration 0:51:28
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)
• Cluster Test Logs zip file of the test logs (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

• Commit ID: 13b6a6d33bf2ec7d6ff0a3b78967343000cfb15a
• Duration 0:55:17
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)
• Cluster Test Logs zip file of the test logs (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-clang on Linux CentOS 7

• Commit ID: cc536becf2a2d5ad435b7a862d1959f780f0b8d5
• Duration 1:03:20
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-clang on Linux CentOS 7

• Commit ID: 13b6a6d33bf2ec7d6ff0a3b78967343000cfb15a
• Duration 0:58:49
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr on Linux CentOS 7

• Commit ID: 13b6a6d33bf2ec7d6ff0a3b78967343000cfb15a
• Duration 1:01:36
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr on Linux CentOS 7

• Commit ID: cc536becf2a2d5ad435b7a862d1959f780f0b8d5
• Duration 1:12:08
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

• Commit ID: 13b6a6d33bf2ec7d6ff0a3b78967343000cfb15a
• Duration 0:50:57
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)
• Cluster Test Logs zip file of the test logs (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-clang on Linux CentOS 7

• Commit ID: 13b6a6d33bf2ec7d6ff0a3b78967343000cfb15a
• Duration 0:51:50
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr on Linux CentOS 7

• Commit ID: 13b6a6d33bf2ec7d6ff0a3b78967343000cfb15a
• Duration 0:53:56
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[jzhou77]

Are the two failures with feature off related?

[kakaiu]

Are the two failures with feature off related?

They are not related.

In PhysicalShardMove.toml, QuietDatabaseConsistencyCheckStart keeps retrying for consistently failed to get information for quiet database. { "Severity": "10", "Time": "15216.265099", "DateTime": "2024-04-05T01:40:42Z", "Type": "QuietDatabaseConsistencyCheckStartError", "Machine": "3.4.3.3:1", "ID": "0000000000000000", "Error": "attribute_not_found", "ErrorDescription": "Attribute not found", "ErrorCode": "2014", "ThreadID": "10437258837474635769", "LogGroup": "default", "Roles": "TS" }

In PerpetualWiggleStorageMigration.toml, ConsistencyChecker keeps retrying for TestFailure: Event Severity="20" Time="599.733958" DateTime="2024-04-05T22:21:57Z" Type="TestFailure" Machine="[abcd::3:4:3:4]:1" ID="0000000000000000" Workload="QuiescentCheck" Reason="Consistency check: Storage server has wrong key-value store type" ThreadID="13943674367234774327" LogGroup="default" Roles="TS"

[foundationdb-ci]

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

• Commit ID: 5022e1feabba5d406fcb395e1ec284dcc7ba03a8
• Duration 0:32:18
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-macos on macOS Ventura 13.x

• Commit ID: 5022e1feabba5d406fcb395e1ec284dcc7ba03a8
• Duration 0:44:19
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

• Commit ID: 5022e1feabba5d406fcb395e1ec284dcc7ba03a8
• Duration 0:49:17
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)
• Cluster Test Logs zip file of the test logs (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-clang on Linux CentOS 7

• Commit ID: 5022e1feabba5d406fcb395e1ec284dcc7ba03a8
• Duration 1:01:33
• Result: :x: FAILED
• Error: Error while executing command: if python3 -m joshua.joshua list --stopped | grep ${ENSEMBLE_ID} | grep -q 'pass=10[0-9][0-9][0-9]'; then echo PASS; else echo FAIL && exit 1; fi. Reason: exit status 1
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr on Linux CentOS 7

• Commit ID: 5022e1feabba5d406fcb395e1ec284dcc7ba03a8
• Duration 1:04:18
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[kakaiu]

CI Clang is failed for Consistency check: Storage server has wrong key-value store type in PerpetualWiggleStorageMigration.toml test, which is not relevant to this PR. So, rekick the CI test.

[foundationdb-ci]

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

• Commit ID: 5022e1feabba5d406fcb395e1ec284dcc7ba03a8
• Duration 0:32:10
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-macos on macOS Ventura 13.x

• Commit ID: 5022e1feabba5d406fcb395e1ec284dcc7ba03a8
• Duration 0:44:22
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

• Commit ID: 5022e1feabba5d406fcb395e1ec284dcc7ba03a8
• Duration 0:49:10
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)
• Cluster Test Logs zip file of the test logs (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-clang on Linux CentOS 7

• Commit ID: 5022e1feabba5d406fcb395e1ec284dcc7ba03a8
• Duration 1:02:01
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr on Linux CentOS 7

• Commit ID: 5022e1feabba5d406fcb395e1ec284dcc7ba03a8
• Duration 1:05:03
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)