[CI] SearchQueryThenFetchAsyncActionTests testMinimumVersionSameAsNewVersion failing

elasticsearchmachine commented 2 weeks ago

Build Scans:

Reproduction Line:

./gradlew ":server:test" --tests "org.elasticsearch.action.search.SearchQueryThenFetchAsyncActionTests.testMinimumVersionSameAsNewVersion" -Dtests.seed=6A7F0165C6787DBD -Dtests.locale=ur -Dtests.timezone=America/Argentina/San_Luis -Druntime.java=22

Applicable branches: 8.x

Reproduces locally?: N/A

Failure History: See dashboard&_a=(controlGroupInput:(chainingSystem:HIERARCHICAL,controlStyle:twoLine,ignoreParentSettings:(ignoreFilters:!f,ignoreQuery:!f,ignoreTimerange:!f,ignoreValidations:!t),panels:('0c0c9cb8-ccd2-45c6-9b13-96bac4abc542':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:task.keyword,grow:!t,id:'0c0c9cb8-ccd2-45c6-9b13-96bac4abc542',searchTechnique:wildcard,selectedOptions:!(),singleSelect:!t,title:'Gradle%20Task',width:medium),grow:!t,order:0,type:optionsListControl,width:small),'144933da-5c1b-4257-a969-7f43455a7901':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:name.keyword,grow:!t,id:'144933da-5c1b-4257-a969-7f43455a7901',searchTechnique:wildcard,selectedOptions:!('testMinimumVersionSameAsNewVersion'),title:Test,width:medium),grow:!t,order:2,type:optionsListControl,width:medium),'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:className.keyword,grow:!t,id:'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850',searchTechnique:wildcard,selectedOptions:!('org.elasticsearch.action.search.SearchQueryThenFetchAsyncActionTests'),title:Suite,width:medium),grow:!t,order:1,type:optionsListControl,width:medium)))))

Failure Message:

java.lang.AssertionError: 
Expected: an instance of org.elasticsearch.action.search.VersionMismatchException
     but: <org.elasticsearch.ElasticsearchException$1: Cannot invoke "java.util.function.BiFunction.apply(Object, Object)" because "this.responseWrapper" is null> is a org.elasticsearch.ElasticsearchException$1

Issue Reasons:

[8.x] 6 failures in test testMinimumVersionSameAsNewVersion (1.5% fail rate in 404 executions)
[8.x] 2 failures in step part1 (2.8% fail rate in 71 executions)
[8.x] 2 failures in step part-1 (2.2% fail rate in 92 executions)
[8.x] 2 failures in pipeline elasticsearch-intake (2.8% fail rate in 71 executions)
[8.x] 2 failures in pipeline elasticsearch-pull-request (2.2% fail rate in 89 executions)
[8.x] 2 failures in pipeline elasticsearch-periodic-platform-support (25.0% fail rate in 8 executions)

Note: This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

elasticsearchmachine commented 2 weeks ago

This has been muted on branch 8.x

Mute Reasons:

[8.x] 6 failures in test testMinimumVersionSameAsNewVersion (1.5% fail rate in 404 executions)
[8.x] 2 failures in step part1 (2.8% fail rate in 71 executions)
[8.x] 2 failures in step part-1 (2.2% fail rate in 92 executions)
[8.x] 2 failures in pipeline elasticsearch-intake (2.8% fail rate in 71 executions)
[8.x] 2 failures in pipeline elasticsearch-pull-request (2.2% fail rate in 89 executions)
[8.x] 2 failures in pipeline elasticsearch-periodic-platform-support (25.0% fail rate in 8 executions)

Build Scans:

elasticsearchmachine commented 2 weeks ago

Pinging @elastic/es-search (Team:Search)

benwtrent commented 2 weeks ago

This one is weird:

Expected: an instance of org.elasticsearch.action.search.VersionMismatchException |  
-- | --
  | but: <org.elasticsearch.ElasticsearchException$1: Cannot invoke "java.util.function.BiFunction.apply(Object, Object)" because "this.responseWrapper" is null> is a org.elasticsearch.ElasticsearchException$1 |  
  | at __randomizedtesting.SeedInfo.seed([6A7F0165C6787DBD:E15F29B806912C67]:0) |  
  | at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:18) |  
  | at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:6) |  
  | at org.elasticsearch.test.ESTestCase.assertThat(ESTestCase.java:2524) |  
  | at org.elasticsearch.action.search.SearchQueryThenFetchAsyncActionTests.testMixedVersionsShardsSearch(SearchQueryThenFetchAsyncActionTests.java:389) |  
  | at org.elasticsearch.action.search.SearchQueryThenFetchAsyncActionTests.testMinimumVersionSameAsNewVersion(SearchQueryThenFetchAsyncActionTests.java:268)

🤔 https://github.com/elastic/elasticsearch/pull/113941 @cbuescher looks like this is still failing?

cbuescher commented 2 weeks ago

@benwtrent I'll take a look. Lets say "its failing" since this test hasn't been running for ages and was just resurrected recently 🙂

cbuescher commented 2 weeks ago

I opened https://github.com/elastic/elasticsearch/pull/114630 for a fix on 8.x. This will need follow up on "main", even though due to the current version being on 9_0_0, I don't expect any issues there yet.

cbuescher commented 1 day ago

Closed with #114630

elastic / elasticsearch

[CI] SearchQueryThenFetchAsyncActionTests testMinimumVersionSameAsNewVersion failing #114593