search

opensearch-project / OpenSearch

🔎 Open source distributed and RESTful search engine.
https://opensearch.org/docs/latest/opensearch/index/
Apache License 2.0
9.05k stars 1.67k forks source link

[BUG] Multiple tests failing with shard is not locked issue #13342

Open BhumikaSaini-Amazon opened 2 months ago

BhumikaSaini-Amazon commented 2 months ago

Describe the bug

  1. https://github.com/opensearch-project/OpenSearch/issues/13207
  2. https://github.com/opensearch-project/OpenSearch/issues/12788
  3. https://github.com/opensearch-project/OpenSearch/issues/12229
  4. https://github.com/opensearch-project/OpenSearch/issues/11952

The above tests seem to be failing due to this issue. Either we are missing some configuration required for the tests or we need some updates in the testing code. We need to debug and resolve this to avoid additional tests being impacted by the same and getting marked as flaky.

Related component

Other

To Reproduce

Run any of the above tests multiple times (2k+). It would fail at least once due to this issue.

Expected behavior

Tests should not fail due to this issue

Additional Details

No response

peternied commented 2 months ago

[Triage - attendees 1 2 3 4 5 6 7] @BhumikaSaini-Amazon Thanks for filing this use, looking forward to the pull request that will address this.

peternied commented 2 months ago

Per @mch2 this could be issue with doc -> seg replication, if that is the case or even if it isn't - should this be fixed before the 2.14 release? Seems like the answer is YES.