Suppress ChosenMachine to fix simulation error(release-7.3)

[hfu94]

backport https://github.com/apple/foundationdb/pull/11277

Code-Reviewer Section

The general pull request guidelines can be found here.

Please check each of the following things and check all boxes before accepting a PR.

• [ ] The PR has a description, explaining both the problem and the solution.
• [ ] The description mentions which forms of testing were done and the testing seems reasonable.
• [ ] Every function/class/actor that was touched is reasonably well documented.

For Release-Branches

If this PR is made against a release-branch, please also check the following:

• [ ] This change/bugfix is a cherry-pick from the next younger branch (younger release-branch or main if this is the youngest branch)
• [ ] There is a good reason why this PR needs to go into a release branch and this reason is documented (either in the description above or in a linked GitHub issue)

[foundationdb-ci]

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

• Commit ID: 16b16d5239658048aec34594f8139f93613e1889
• Duration 0:33:04
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-macos on macOS Ventura 13.x

• Commit ID: 16b16d5239658048aec34594f8139f93613e1889
• Duration 0:46:21
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-clang on Linux CentOS 7

• Commit ID: 16b16d5239658048aec34594f8139f93613e1889
• Duration 0:49:36
• Result: :x: FAILED
• Error: Error while executing command: if python3 -m joshua.joshua list --stopped | grep ${ENSEMBLE_ID} | grep -q 'pass=10[0-9][0-9][0-9]'; then echo PASS; else echo FAIL && exit 1; fi. Reason: exit status 1
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

• Commit ID: 16b16d5239658048aec34594f8139f93613e1889
• Duration 0:51:28
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)
• Cluster Test Logs zip file of the test logs (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr on Linux CentOS 7

• Commit ID: 16b16d5239658048aec34594f8139f93613e1889
• Duration 0:56:04
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[hfu94]

it seems it still have that error, i will have to test if it still fails after i increase the trace allowed.

[hfu94]

now it fails for a different reason: it now indefinitely run ConsistencyCheck and eventually fail, the count of all logs are similar, there is no outlier logs having significantly more count.

[hfu94]

trace.0.0.0.0.305556.1712443967.EDV7Cg.1.31.xml:<Event Severity="40" ErrorKind="Unset" Time="5388.372710" DateTime="2024-04-06T23:02:32Z" Type="TestFailure" Machine="[abcd::3:4:3:2]:1" ID="0000000000000000" Workload="QuiescentCheck" Reason="Consistency check: Storage server has wrong key-value store type" ThreadID="18199472092616994695" Backtrace="addr2line -e fdbserver.debug -p -C -f -i 0x556611d 0x55663e3 0x55605e4 0x398b5b0 0x39907d0 0x3991638 0x271d4f8 0x271cb5c 0x271e248 0x271da0c 0x1c09468 0x1c09287 0x5337fbd 0x5337893 0x1bb5018 0x542ca61 0x542c57a 0x32946cc 0x7f7b91281555" LogGroup="default" Roles="TS" />

[hfu94]

so the test did not fail, but there is a log Workload="QuiescentCheck" Reason="Consistency check: Storage server has wrong key-value store type" with Severity="40" making it failed.

1 tests passed; 0 tests failed.
Waiting for DD to end...
Set perpetual_storage_wiggle=0 ...
Set perpetual_storage_wiggle=0 Done.

Unseed: 78803
Elapsed: 5523.313302 simsec, 602.685939 real seconds
1 SevError events logged

[hfu94]

here is where it fails https://github.com/apple/foundationdb/blame/985d4765f2ca0d82c4f08479558b38b286f26a49/fdbserver/workloads/ConsistencyCheck.actor.cpp#L946-L953

[hfu94]

conclusion: this test fails for two different reasons, one of them is fixed by this PR, the other is related to the logic of this test and causing consistency check to repetitively fail. It is possible that only with the second reason that the first symptom would manifest, but it should still be a good idea to limit the number of logs that is possible.

[foundationdb-ci]

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

• Commit ID: 16b16d5239658048aec34594f8139f93613e1889
• Duration 0:33:33
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-macos on macOS Ventura 13.x

• Commit ID: 16b16d5239658048aec34594f8139f93613e1889
• Duration 0:44:24
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

• Commit ID: 16b16d5239658048aec34594f8139f93613e1889
• Duration 0:50:22
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)
• Cluster Test Logs zip file of the test logs (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr on Linux CentOS 7

• Commit ID: 16b16d5239658048aec34594f8139f93613e1889
• Duration 1:01:48
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-clang on Linux CentOS 7

• Commit ID: 16b16d5239658048aec34594f8139f93613e1889
• Duration 1:06:34
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

• Commit ID: 207408afd2e7bd9dab2672c39d84e20df6d673aa
• Duration 0:31:42
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-macos on macOS Ventura 13.x

• Commit ID: 207408afd2e7bd9dab2672c39d84e20df6d673aa
• Duration 0:43:57
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

• Commit ID: 207408afd2e7bd9dab2672c39d84e20df6d673aa
• Duration 0:49:01
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)
• Cluster Test Logs zip file of the test logs (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-clang on Linux CentOS 7

• Commit ID: 207408afd2e7bd9dab2672c39d84e20df6d673aa
• Duration 1:04:29
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr on Linux CentOS 7

• Commit ID: 207408afd2e7bd9dab2672c39d84e20df6d673aa
• Duration 1:24:55
• Result: :x: FAILED
• Error: Error while executing command: if python3 -m joshua.joshua list --stopped | grep ${ENSEMBLE_ID} | grep -q 'pass=10[0-9][0-9][0-9]'; then echo PASS; else echo FAIL && exit 1; fi. Reason: exit status 1
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

• Commit ID: 258d8926646142b95439678a9f2d948df64e7b54
• Duration 0:32:31
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

• Commit ID: 258d8926646142b95439678a9f2d948df64e7b54
• Duration 0:37:24
• Result: :x: FAILED
• Error: Error while executing command: docker build --label "org.foundationdb.version=${FDB_VERSION}" --label "org.foundationdb.build_date=${BUILD_DATE}" --label "org.foundationdb.commit=${COMMIT_SHA}" --progress plain --build-arg FDB_VERSION="${FDB_VERSION}" --build-arg FDB_LIBRARY_VERSIONS="${FDB_VERSION}" --build-arg FDB_WEBSITE="${FDB_WEBSITE}" --tag foundationdb/go-build:${FDB_VERSION}-${COMMIT_SHA} --file Dockerfile --target go-build .. Reason: exit status 1
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)
• Cluster Test Logs zip file of the test logs (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-macos on macOS Ventura 13.x

• Commit ID: 258d8926646142b95439678a9f2d948df64e7b54
• Duration 0:44:43
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-clang on Linux CentOS 7

• Commit ID: 258d8926646142b95439678a9f2d948df64e7b54
• Duration 1:04:40
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr on Linux CentOS 7

• Commit ID: 258d8926646142b95439678a9f2d948df64e7b54
• Duration 1:05:33
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

• Commit ID: 3cd64eabe7062f252e22cc1952034302367df77d
• Duration 0:32:17
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-clang on Linux CentOS 7

• Commit ID: 3cd64eabe7062f252e22cc1952034302367df77d
• Duration 0:48:11
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr on Linux CentOS 7

• Commit ID: 3cd64eabe7062f252e22cc1952034302367df77d
• Duration 0:52:33
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

• Commit ID: 3cd64eabe7062f252e22cc1952034302367df77d
• Duration 0:52:48
• Result: :white_check_mark: SUCCEEDED
• Error: N/A
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)
• Cluster Test Logs zip file of the test logs (available for 30 days)