opensearch-project / neural-search

Plugin that adds dense neural retrieval into the OpenSearch ecosytem
Apache License 2.0
57 stars 58 forks source link

[BUG] Flaky test: testReduceWithConcurrentSegmentSearch_whenMultipleCollectorsMatchedDocs_thenSuccessful #819

Open chishui opened 6 days ago

chishui commented 6 days ago

What is the bug?

testReduceWithConcurrentSegmentSearch_whenMultipleCollectorsMatchedDocs_thenSuccessful failed in gradle check: https://github.com/opensearch-project/neural-search/actions/runs/9788202904/job/27025892009?pr=769

How can one reproduce the bug?

It can be reproduced locally with command

./gradlew ':test' --tests "org.opensearch.neuralsearch.search.query.HybridCollectorManagerTests.testReduceWithConcurrentSegmentSearch_whenMultipleCollectorsMatchedDocs_thenSuccessful" -Dtests.seed=8305B866B5D072CE -Dtests.security.manager=false -Dtests.locale=af-ZA -Dtests.timezone=Europe/Uzhgorod

However, if remove the -Dtests.seed=8305B866B5D072CE, the test will pass.

What is the expected behavior?

The UT will pass with or without seed.

What is your host/environment?

linux/macos

Do you have any screenshots?

N/A

Do you have any additional context?

N/A

chishui commented 6 days ago

@martin-gaievski could you take a look?