opensearch-project / OpenSearch

🔎 Open source distributed and RESTful search engine.

https://opensearch.org/docs/latest/opensearch/index/

Apache License 2.0

8.89k stars 1.63k forks source link

Handle shard over allocation during partial zone/rack or independent node failures #1149

Closed Bukhtawar closed 2 years ago

Bukhtawar commented 2 years ago

Signed-off-by: Bukhtawar Khan bukhtawa@amazon.com

Description

The changes ensure that in the event of a partial zone failure, the surviving nodes in the minority zone don't get overloaded with shards, this is governed by a skewness limit.

Issues Resolved

938

Check List

[ ] Add support for absolute skewness limits
[ ] Add more unit tests
[ ] Add integ tests
[x] New functionality includes testing.
- [x] All tests pass
[ ] New functionality has been documented.
- [ ] New functionality has javadoc added
[x] Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. For more information on following Developer Certificate of Origin and signing off your commits, please check here.

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success fdd86f6fac3b12b089d7b31646b0afe7cec9d01f

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed fdd86f6fac3b12b089d7b31646b0afe7cec9d01f

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success c8a2066f609907acb153a2ccfe8242d05c5cd7dc

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed c8a2066f609907acb153a2ccfe8242d05c5cd7dc

opensearch-ci-bot commented 2 years ago

:x: Gradle Precommit failure fdd86f6fac3b12b089d7b31646b0afe7cec9d01f Log 975

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Precommit success c8a2066f609907acb153a2ccfe8242d05c5cd7dc

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed 4561a95547df43c28a8a04b3477e8e421b5730b3

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success 4561a95547df43c28a8a04b3477e8e421b5730b3

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Precommit success 4561a95547df43c28a8a04b3477e8e421b5730b3

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success 1a2a6a4ed37c5be73f75fbfc9dca050b3be145d2

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed 1a2a6a4ed37c5be73f75fbfc9dca050b3be145d2

opensearch-ci-bot commented 2 years ago

:x: Gradle Precommit failure 1a2a6a4ed37c5be73f75fbfc9dca050b3be145d2 Log 978

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed cd20052d7d1b7dcf4089a96159602ab65c38d067

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success cd20052d7d1b7dcf4089a96159602ab65c38d067

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Precommit success cd20052d7d1b7dcf4089a96159602ab65c38d067

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed 4eaf4b5c9773a73472a0f64a689b526f4688d7a2

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success 4eaf4b5c9773a73472a0f64a689b526f4688d7a2

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed 9d29e79aa55b0832dfeef505e7b38208a13dabad

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success 9d29e79aa55b0832dfeef505e7b38208a13dabad

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Precommit success 4eaf4b5c9773a73472a0f64a689b526f4688d7a2

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Precommit success 9d29e79aa55b0832dfeef505e7b38208a13dabad

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success 00c7f10e1962c668f1aa007240fbba0da53d0f8e

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed 00c7f10e1962c668f1aa007240fbba0da53d0f8e

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Precommit success 00c7f10e1962c668f1aa007240fbba0da53d0f8e

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed 6ce9f9b477afe599889c2e7ac9d38df9557d2c30

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success 6ce9f9b477afe599889c2e7ac9d38df9557d2c30

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Precommit success 6ce9f9b477afe599889c2e7ac9d38df9557d2c30

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success 4a5ac648aac3d8966adab9bbdb8f9b2aecf41a30

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed 4a5ac648aac3d8966adab9bbdb8f9b2aecf41a30

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Precommit success 4a5ac648aac3d8966adab9bbdb8f9b2aecf41a30

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success 0ac7cdaf96d2f1e9d14c727b578947ca0e32ca95

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed 0ac7cdaf96d2f1e9d14c727b578947ca0e32ca95

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Precommit success 0ac7cdaf96d2f1e9d14c727b578947ca0e32ca95

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success bcac33f9c40fbd5af72b50f9abbb50a269e2ca09

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed bcac33f9c40fbd5af72b50f9abbb50a269e2ca09

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Precommit success bcac33f9c40fbd5af72b50f9abbb50a269e2ca09

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed bba46928e93ca625faf673b11e952386f6434473

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success bba46928e93ca625faf673b11e952386f6434473

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Precommit success bba46928e93ca625faf673b11e952386f6434473

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed efa06c20357e37358905c183d14c4286a8342aa9

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success efa06c20357e37358905c183d14c4286a8342aa9

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Precommit success efa06c20357e37358905c183d14c4286a8342aa9

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success e84197972a3c97f834f76ef4112e80abdbbd5141

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed e84197972a3c97f834f76ef4112e80abdbbd5141

opensearch-ci-bot commented 2 years ago

:x: Gradle Precommit failure e84197972a3c97f834f76ef4112e80abdbbd5141 Log 1116

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success 20c721429c99fa9fe56053859056f8844f0a43ab

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed 20c721429c99fa9fe56053859056f8844f0a43ab

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Precommit success 20c721429c99fa9fe56053859056f8844f0a43ab

opensearch-ci-bot commented 2 years ago

:white_check_mark: Gradle Wrapper Validation success 9556fd0f0f850d196b1e7cfb8f4a3631b33c0e9a

opensearch-ci-bot commented 2 years ago

:white_check_mark: DCO Check Passed 9556fd0f0f850d196b1e7cfb8f4a3631b33c0e9a

Next