apple / foundationdb

FoundationDB - the open source, distributed, transactional key-value store

https://apple.github.io/foundationdb/

Apache License 2.0

14.19k stars 1.29k forks source link

[release-7.3] Add a knob for merge parallelism and add log for max shard size. #11389

Closed yao-xiao-github closed 1 month ago

yao-xiao-github commented 1 month ago

https://github.com/apple/foundationdb/pull/11342 https://github.com/apple/foundationdb/pull/11395

Code-Reviewer Section

The general pull request guidelines can be found here.

Please check each of the following things and check all boxes before accepting a PR.

[ ] The PR has a description, explaining both the problem and the solution.
[ ] The description mentions which forms of testing were done and the testing seems reasonable.
[ ] Every function/class/actor that was touched is reasonably well documented.

For Release-Branches

If this PR is made against a release-branch, please also check the following:

[ ] This change/bugfix is a cherry-pick from the next younger branch (younger release-branch or main if this is the youngest branch)
[ ] There is a good reason why this PR needs to go into a release branch and this reason is documented (either in the description above or in a linked GitHub issue)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

Commit ID: a2de802e536010f6d305aaeaeac098890eeed5ea
Duration 0:32:35
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

Commit ID: a2de802e536010f6d305aaeaeac098890eeed5ea
Duration 0:59:48
Result: :x: FAILED
Error: Error while executing command: docker build --label "org.foundationdb.version=${FDB_VERSION}" --label "org.foundationdb.build_date=${BUILD_DATE}" --label "org.foundationdb.commit=${COMMIT_SHA}" --progress plain --build-arg FDB_VERSION="${FDB_VERSION}" --build-arg FDB_LIBRARY_VERSIONS="${FDB_VERSION}" --build-arg FDB_WEBSITE="${FDB_WEBSITE}" --tag foundationdb/ycsb:${FDB_VERSION}-${COMMIT_SHA}-debug --file Dockerfile.eks --target ycsb .. Reason: exit status 1
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)
Cluster Test Logs zip file of the test logs (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr on Linux CentOS 7

Commit ID: a2de802e536010f6d305aaeaeac098890eeed5ea
Duration 1:12:28
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-clang on Linux CentOS 7

Commit ID: a2de802e536010f6d305aaeaeac098890eeed5ea
Duration 1:13:43
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

Commit ID: b4c3f4e610eb9e1c6daa73075536f79b592bd6e7
Duration 0:32:35
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

Commit ID: b4c3f4e610eb9e1c6daa73075536f79b592bd6e7
Duration 0:43:27
Result: :x: FAILED
Error: Error while executing command: docker build --label "org.foundationdb.version=${FDB_VERSION}" --label "org.foundationdb.build_date=${BUILD_DATE}" --label "org.foundationdb.commit=${COMMIT_SHA}" --progress plain --build-arg FDB_VERSION="${FDB_VERSION}" --build-arg FDB_LIBRARY_VERSIONS="${FDB_VERSION}" --build-arg FDB_WEBSITE="${FDB_WEBSITE}" --tag foundationdb/ycsb:${FDB_VERSION}-${COMMIT_SHA}-debug --file Dockerfile.eks --target ycsb .. Reason: exit status 1
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)
Cluster Test Logs zip file of the test logs (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-macos on macOS Ventura 13.x

Commit ID: b4c3f4e610eb9e1c6daa73075536f79b592bd6e7
Duration 0:44:23
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr on Linux CentOS 7

Commit ID: b4c3f4e610eb9e1c6daa73075536f79b592bd6e7
Duration 1:03:00
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-clang on Linux CentOS 7

Commit ID: b4c3f4e610eb9e1c6daa73075536f79b592bd6e7
Duration 1:06:47
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-clang on Linux CentOS 7

Commit ID: 2f1d5f22a858bf77ac7168cefecd0ed3be576593
Duration 0:08:39
Result: :x: FAILED
Error: reference not found for primary source and source version 2f1d5f22a858bf77ac7168cefecd0ed3be576593
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr on Linux CentOS 7

Commit ID: 2f1d5f22a858bf77ac7168cefecd0ed3be576593
Duration 0:08:50
Result: :x: FAILED
Error: reference not found for primary source and source version 2f1d5f22a858bf77ac7168cefecd0ed3be576593
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

Commit ID: 2f1d5f22a858bf77ac7168cefecd0ed3be576593
Duration 0:08:59
Result: :x: FAILED
Error: reference not found for primary source and source version 2f1d5f22a858bf77ac7168cefecd0ed3be576593
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)
Cluster Test Logs zip file of the test logs (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

Commit ID: f9b717cf0152216876a83304c40fe36bf82ea154
Duration 0:45:41
Result: :x: FAILED
Error: Error while executing command: docker build --label "org.foundationdb.version=${FDB_VERSION}" --label "org.foundationdb.build_date=${BUILD_DATE}" --label "org.foundationdb.commit=${COMMIT_SHA}" --progress plain --build-arg FDB_VERSION="${FDB_VERSION}" --build-arg FDB_LIBRARY_VERSIONS="${FDB_VERSION}" --build-arg FDB_WEBSITE="${FDB_WEBSITE}" --tag foundationdb/ycsb:${FDB_VERSION}-${COMMIT_SHA}-debug --file Dockerfile.eks --target ycsb .. Reason: exit status 1
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)
Cluster Test Logs zip file of the test logs (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-clang on Linux CentOS 7

Commit ID: f9b717cf0152216876a83304c40fe36bf82ea154
Duration 0:50:31
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr on Linux CentOS 7

Commit ID: f9b717cf0152216876a83304c40fe36bf82ea154
Duration 1:22:27
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

Commit ID: fdcf67373b7b940f7a44b7790bc73c4e7bef5a67
Duration 0:32:26
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr on Linux CentOS 7

Commit ID: fdcf67373b7b940f7a44b7790bc73c4e7bef5a67
Duration 0:38:55
Result: :x: FAILED
Error: Error while executing command: ctest -j ${NPROC} --no-compress-output -T test --output-on-failure. Reason: exit status 8
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

Commit ID: fdcf67373b7b940f7a44b7790bc73c4e7bef5a67
Duration 0:44:13
Result: :x: FAILED
Error: Error while executing command: docker build --label "org.foundationdb.version=${FDB_VERSION}" --label "org.foundationdb.build_date=${BUILD_DATE}" --label "org.foundationdb.commit=${COMMIT_SHA}" --progress plain --build-arg FDB_VERSION="${FDB_VERSION}" --build-arg FDB_LIBRARY_VERSIONS="${FDB_VERSION}" --build-arg FDB_WEBSITE="${FDB_WEBSITE}" --tag foundationdb/ycsb:${FDB_VERSION}-${COMMIT_SHA}-debug --file Dockerfile.eks --target ycsb .. Reason: exit status 1
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)
Cluster Test Logs zip file of the test logs (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-macos on macOS Ventura 13.x

Commit ID: fdcf67373b7b940f7a44b7790bc73c4e7bef5a67
Duration 0:45:43
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-clang on Linux CentOS 7

Commit ID: fdcf67373b7b940f7a44b7790bc73c4e7bef5a67
Duration 1:15:00
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-macos-m1 on macOS Ventura 13.x

Commit ID: fdcf67373b7b940f7a44b7790bc73c4e7bef5a67
Duration 0:32:21
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-cluster-tests on Linux CentOS 7

Commit ID: fdcf67373b7b940f7a44b7790bc73c4e7bef5a67
Duration 0:41:52
Result: :x: FAILED
Error: Error while executing command: docker build --label "org.foundationdb.version=${FDB_VERSION}" --label "org.foundationdb.build_date=${BUILD_DATE}" --label "org.foundationdb.commit=${COMMIT_SHA}" --progress plain --build-arg FDB_VERSION="${FDB_VERSION}" --build-arg FDB_LIBRARY_VERSIONS="${FDB_VERSION}" --build-arg FDB_WEBSITE="${FDB_WEBSITE}" --tag foundationdb/ycsb:${FDB_VERSION}-${COMMIT_SHA}-debug --file Dockerfile.eks --target ycsb .. Reason: exit status 1
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)
Cluster Test Logs zip file of the test logs (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-macos on macOS Ventura 13.x

Commit ID: fdcf67373b7b940f7a44b7790bc73c4e7bef5a67
Duration 0:45:04
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr on Linux CentOS 7

Commit ID: fdcf67373b7b940f7a44b7790bc73c4e7bef5a67
Duration 1:06:43
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)

foundationdb-ci commented 1 month ago

Result of foundationdb-pr-clang on Linux CentOS 7

Commit ID: fdcf67373b7b940f7a44b7790bc73c4e7bef5a67
Duration 1:07:10
Result: :white_check_mark: SUCCEEDED
Error: N/A
Build Log terminal output (available for 30 days)
Build Workspace zip file of the working directory (available for 30 days)