search

elastic / elasticsearch

Free and Open Source, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
447 stars 24.78k forks source link

[CI] SearchQueryIT testAllDocsQueryString failing #115728

Open elasticsearchmachine opened 2 days ago

elasticsearchmachine commented 2 days ago

Build Scans:

Reproduction Line:

./gradlew ":server:internalClusterTest" --tests "org.elasticsearch.search.query.SearchQueryIT.testAllDocsQueryString" -Dtests.seed=99F013EBD9BC8D98 -Dtests.locale=et -Dtests.timezone=Europe/Bratislava -Druntime.java=22

Applicable branches: main

Reproduces locally?: N/A

Failure History: See dashboard&_a=(controlGroupState:(initialChildControlState:('0c0c9cb8-ccd2-45c6-9b13-96bac4abc542':(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,fieldName:task.keyword,order:0,selectedOptions:!(),title:'GradleTask',type:optionsListControl),'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850':(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,fieldName:className.keyword,order:1,selectedOptions:!(org.elasticsearch.search.query.SearchQueryIT),title:'Suite',type:optionsListControl),'144933da-5c1b-4257-a969-7f43455a7901':(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,fieldName:name.keyword,order:2,selectedOptions:!(testAllDocsQueryString),title:'Test',type:optionsListControl)))))

Failure Message:

java.lang.Exception: Test abandoned because suite timeout was reached.

Issue Reasons:

Note: This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

elasticsearchmachine commented 2 days ago

Pinging @elastic/es-search (Team:Search)

benwtrent commented 2 days ago

OK, failed twice due to suite timeout. Both of these were Linux.

Interestingly, this was part of the ERROR output of the test:

1> [2024-10-27T21:18:55,037][INFO ][o.e.s.q.SearchQueryIT    ] [testAllDocsQueryString] before test |  
  | 1> [2024-10-27T21:18:55,038][INFO ][o.e.s.q.SearchQueryIT    ] [testAllDocsQueryString] [SearchQueryIT#testAllDocsQueryString]: setting up test |  
  | 1> [2024-10-27T21:18:55,042][INFO ][o.e.c.m.MetadataIndexTemplateService] [node_s0] adding template [random_index_template] for index patterns [*] |  
  | 1> [2024-10-27T21:18:55,051][INFO ][o.e.s.q.SearchQueryIT    ] [testAllDocsQueryString] [SearchQueryIT#testAllDocsQueryString]: all set up test |  
  | 1> [2024-10-27T21:18:55,054][INFO ][o.e.c.m.MetadataCreateIndexService] [node_s0] [test] creating index, cause [api], templates [random_index_template], shards [4]/[2] |  
  | 1> [2024-10-27T21:18:55,103][INFO ][o.e.s.q.SearchQueryIT    ] [testAllDocsQueryString] Index [4] docs async: [true] bulk: [false] |  
  | 1> [2024-10-27T21:18:55,117][INFO ][o.e.c.m.MetadataMappingService] [node_s0] [test/NWUCp2YAQN-CaWqRps31ZQ] create_mapping |  
  | 1> [2024-10-27T21:18:55,118][INFO ][o.e.c.m.MetadataMappingService] [node_s0] [test/NWUCp2YAQN-CaWqRps31ZQ] update_mapping [_doc] |  
  | 1> [2024-10-27T21:18:55,177][INFO ][o.e.c.r.a.AllocationService] [node_s0] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[test][1]]])." previous.health="YELLOW" reason="shards started [[test][1]]" |  
  | 1> [2024-10-27T21:22:26,757][ERROR][o.e.t.LeakTracker        ] [[Cleaner-0]] LEAK: resource was not cleaned up before it was garbage-collected.

<br class="Apple-interchange-newline">message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[test][1]]])." previous.health="YELLOW" reason="shards started [[test][1]]" |  
-- | --
  | 1> [2024-10-27T21:22:26,757][ERROR][o.e.t.LeakTracker        ] [[Cleaner-0]] LEAK: resource was not cleaned up before it was garbage-collected. |  
  | 1> Recent access records: |  
  | 1> Created at: |  
  | 1>  in [TEST-SearchQueryIT.testAllDocsQueryString-seed#[99F013EBD9BC8D98]][testAllDocsQueryString] |  
  | 1>  org.elasticsearch.action.search.ArraySearchPhaseResults.<init>(ArraySearchPhaseResults.java:28) |  
  | 1>  org.elasticsearch.action.search.QueryPhaseResultConsumer.<init>(QueryPhaseResultConsumer.java:85) |  
  | 1>  org.elasticsearch.action.search.SearchPhaseController.newSearchPhaseResults(SearchPhaseController.java:824) |  
  | 1>  org.elasticsearch.action.search.TransportSearchAction$AsyncSearchActionProvider.newSearchPhase(TransportSearchAction.java:1502) |  
  | 1>  org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:1305) |  
  | 1>  org.elasticsearch.action.search.TransportSearchAction.executeLocalSearch(TransportSearchAction.java:1038) |  
  | 1>  org.elasticsearch.action.search.TransportSearchAction.lambda$executeRequest$4(TransportSearchAction.java:365) |  
  | 1>  org.elasticsearch.action.ActionListenerImplementations$ResponseWrappingActionListener.onResponse(ActionListenerImplementations.java:247) |  
  | 1>  org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:109) |  
  | 1>  org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:77) |  
  | 1>  org.elasticsearch.action.search.TransportSearchAction.executeRequest(TransportSearchAction.java:531) |  
  | 1>  org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:316) |  
  | 1>  org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:121) |  
  | 1>  org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:135) |  
  | 1>  org.elasticsearch.action.support.TransportAction.handleExecution(TransportAction.java:96) |  
  | 1>  org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:59) |  
  | 1>  org.elasticsearch.tasks.TaskManager.registerAndExecute(TaskManager.java:197) |  
  | 1>  org.elasticsearch.client.internal.node.NodeClient.executeLocally(NodeClient.java:106) |  
  | 1>  org.elasticsearch.client.internal.node.NodeClient.doExecute(NodeClient.java:84) |  
  | 1>  org.elasticsearch.client.internal.support.AbstractClient.execute(AbstractClient.java:140) |  
  | 1>  org.elasticsearch.client.internal.FilterClient.doExecute(FilterClient.java:56) |  
  | 1>  org.elasticsearch.client.internal.support.AbstractClient.execute(AbstractClient.java:140) |  
  | 1>  org.elasticsearch.client.internal.support.AbstractClient.execute(AbstractClient.java:126) |  
  | 1>  org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:37) |  
  | 1>  org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:44) |  
  | 1>  org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:17) |  
  | 1>  org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertResponse(ElasticsearchAssertions.java:382) |  
  | 1>  org.elasticsearch.search.query.SearchQueryIT.testAllDocsQueryString(SearchQueryIT.java:301) |  
  | 1>  java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103) |  
  | 1>  java.base/java.lang.reflect.Method.invoke(Method.java:580) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) |  
  | 1>  org.junit.rules.RunRules.evaluate(RunRules.java:20) |  
  | 1>  org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) |  
  | 1>  org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) |  
  | 1>  org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) |  
  | 1>  org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) |  
  | 1>  org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) |  
  | 1>  org.junit.rules.RunRules.evaluate(RunRules.java:20) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) |  
  | 1>  com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) |  
  | 1>  com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) |  
  | 1>  com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) |  
  | 1>  org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) |  
  | 1>  org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) |  
  | 1>  org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) |  
  | 1>  org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) |  
  | 1>  org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) |  
  | 1>  org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) |  
  | 1>  org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47) |  
  | 1>  org.junit.rules.RunRules.evaluate(RunRules.java:20) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) |  
  | 1>  com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) |  
  | 1>  com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850) |  
  | 1>  java.base/java.lang.Thread.run(Thread.java:1570) |  
  | 1> [2024-10-27T21:22:26,758][ERROR][o.e.t.LeakTracker        ] [[Cleaner-0]] LEAK: resource was not cleaned up before it was garbage-collected. |  
  | 1> Recent access records: |  
  | 1> Created at: |  
  | 1>  in [TEST-SearchQueryIT.testAllDocsQueryString-seed#[99F013EBD9BC8D98]][testAllDocsQueryString] |  
  | 1>  org.elasticsearch.action.search.ArraySearchPhaseResults.<init>(ArraySearchPhaseResults.java:28) |  
  | 1>  org.elasticsearch.action.search.SearchDfsQueryThenFetchAsyncAction.<init>(SearchDfsQueryThenFetchAsyncAction.java:70) |  
  | 1>  org.elasticsearch.action.search.TransportSearchAction$AsyncSearchActionProvider.newSearchPhase(TransportSearchAction.java:1515) |  
  | 1>  org.elasticsearch.action.search.TransportSearchAction.executeSearch(TransportSearchAction.java:1305) |  
  | 1>  org.elasticsearch.action.search.TransportSearchAction.executeLocalSearch(TransportSearchAction.java:1038) |  
  | 1>  org.elasticsearch.action.search.TransportSearchAction.lambda$executeRequest$4(TransportSearchAction.java:365) |  
  | 1>  org.elasticsearch.action.ActionListenerImplementations$ResponseWrappingActionListener.onResponse(ActionListenerImplementations.java:247) |  
  | 1>  org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:109) |  
  | 1>  org.elasticsearch.index.query.Rewriteable.rewriteAndFetch(Rewriteable.java:77) |  
  | 1>  org.elasticsearch.action.search.TransportSearchAction.executeRequest(TransportSearchAction.java:531) |  
  | 1>  org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:316) |  
  | 1>  org.elasticsearch.action.search.TransportSearchAction.doExecute(TransportSearchAction.java:121) |  
  | 1>  org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:135) |  
  | 1>  org.elasticsearch.action.support.TransportAction.handleExecution(TransportAction.java:96) |  
  | 1>  org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:59) |  
  | 1>  org.elasticsearch.tasks.TaskManager.registerAndExecute(TaskManager.java:197) |  
  | 1>  org.elasticsearch.client.internal.node.NodeClient.executeLocally(NodeClient.java:106) |  
  | 1>  org.elasticsearch.client.internal.node.NodeClient.doExecute(NodeClient.java:84) |  
  | 1>  org.elasticsearch.client.internal.support.AbstractClient.execute(AbstractClient.java:140) |  
  | 1>  org.elasticsearch.client.internal.FilterClient.doExecute(FilterClient.java:56) |  
  | 1>  org.elasticsearch.client.internal.support.AbstractClient.execute(AbstractClient.java:140) |  
  | 1>  org.elasticsearch.client.internal.support.AbstractClient.execute(AbstractClient.java:126) |  
  | 1>  org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:37) |  
  | 1>  org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:44) |  
  | 1>  org.elasticsearch.action.ActionRequestBuilder.get(ActionRequestBuilder.java:17) |  
  | 1>  org.elasticsearch.test.hamcrest.ElasticsearchAssertions.assertResponse(ElasticsearchAssertions.java:382) |  
  | 1>  org.elasticsearch.search.query.SearchQueryIT.testAllDocsQueryString(SearchQueryIT.java:301) |  
  | 1>  java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103) |  
  | 1>  java.base/java.lang.reflect.Method.invoke(Method.java:580) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) |  
  | 1>  org.junit.rules.RunRules.evaluate(RunRules.java:20) |  
  | 1>  org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48) |  
  | 1>  org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) |  
  | 1>  org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) |  
  | 1>  org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) |  
  | 1>  org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) |  
  | 1>  org.junit.rules.RunRules.evaluate(RunRules.java:20) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) |  
  | 1>  com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) |  
  | 1>  com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843) |  
  | 1>  com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891) |  
  | 1>  com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:902) |  
  | 1>  org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) |  
  | 1>  org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) |  
  | 1>  org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) |  
  | 1>  org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) |  
  | 1>  org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) |  
  | 1>  org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) |  
  | 1>  org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47) |  
  | 1>  org.junit.rules.RunRules.evaluate(RunRules.java:20) |  
  | 1>  com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) |  
  | 1>  com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390) |  
  | 1>  com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:850) |  
  | 1>  java.base/java.lang.Thread.run(Thread.java:1570)
elasticsearchmachine commented 2 days ago

Pinging @elastic/es-search-foundations (Team:Search Foundations)