[CI] MixedClusterEsqlSpecIT test {categorize.Categorize ASYNC} failing

elasticsearchmachine commented 3 weeks ago

Build Scans:

Reproduction Line:

./gradlew ":x-pack:plugin:esql:qa:server:mixed-cluster:v8.16.0#javaRestTest" -Dtests.class="org.elasticsearch.xpack.esql.qa.mixed.MixedClusterEsqlSpecIT" -Dtests.method="test {categorize.Categorize ASYNC}" -Dtests.seed=DA6FFF5BC79A0E06 -Dtests.bwc=true -Dtests.locale=sg-Latn-CF -Dtests.timezone=America/Adak -Druntime.java=22

Applicable branches: 8.x

Reproduces locally?: N/A

Failure History: See dashboard&_a=(controlGroupInput:(chainingSystem:HIERARCHICAL,controlStyle:twoLine,ignoreParentSettings:(ignoreFilters:!f,ignoreQuery:!f,ignoreTimerange:!f,ignoreValidations:!t),panels:('0c0c9cb8-ccd2-45c6-9b13-96bac4abc542':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:task.keyword,grow:!t,id:'0c0c9cb8-ccd2-45c6-9b13-96bac4abc542',searchTechnique:wildcard,selectedOptions:!(),singleSelect:!t,title:'Gradle%20Task',width:medium),grow:!t,order:0,type:optionsListControl,width:small),'144933da-5c1b-4257-a969-7f43455a7901':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:name.keyword,grow:!t,id:'144933da-5c1b-4257-a969-7f43455a7901',searchTechnique:wildcard,selectedOptions:!('test%20%7Bcategorize.Categorize%20ASYNC%7D'),title:Test,width:medium),grow:!t,order:2,type:optionsListControl,width:medium),'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:className.keyword,grow:!t,id:'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850',searchTechnique:wildcard,selectedOptions:!('org.elasticsearch.xpack.esql.qa.mixed.MixedClusterEsqlSpecIT'),title:Suite,width:medium),grow:!t,order:1,type:optionsListControl,width:medium)))))

Failure Message:

java.lang.AssertionError: Data mismatch:
row 0 column 0:a list containing
row 0 column 0:0: expected "3" but was "1"
row 0 column 1:a list containing
row 0 column 1:0: expected "[Connected to 10.1.0.1, Connected to 10.1.0.2, Connected to 10.1.0.3]" but was "Disconnected"
row 1 column 1:a list containing
row 1 column 1:0: expected "Connection error" but was "[Connected to 10.1.0.1, Connected to 10.1.0.2, Connected to 10.1.0.3]"
row 2 column 0:a list containing
row 2 column 0:0: expected "1" but was "3"
row 2 column 1:a list containing
row 2 column 1:0: expected "Disconnected" but was "Connection error"

Issue Reasons:

[8.x] 3 failures in test test {categorize.Categorize ASYNC} (0.7% fail rate in 405 executions)
[8.x] 3 failures in step 8.16.0_bwc-snapshots (1.1% fail rate in 265 executions)
[8.x] 2 failures in pipeline elasticsearch-pull-request (1.3% fail rate in 150 executions)

Note: This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

elasticsearchmachine commented 3 weeks ago

This has been muted on branch main

Mute Reasons:

[main] 4 failures in test test {categorize.Categorize ASYNC} (0.5% fail rate in 794 executions)
[main] 2 failures in step 8.16.0_bwc-snapshots (0.6% fail rate in 359 executions)
[main] 3 failures in pipeline elasticsearch-pull-request (1.1% fail rate in 275 executions)

Build Scans:

elasticsearchmachine commented 3 weeks ago

Pinging @elastic/es-analytical-engine (Team:Analytics)

elasticsearchmachine commented 1 week ago

This has been muted on branch 8.x

Mute Reasons:

[8.x] 3 failures in test test {categorize.Categorize ASYNC} (0.7% fail rate in 405 executions)
[8.x] 3 failures in step 8.16.0_bwc-snapshots (1.1% fail rate in 265 executions)
[8.x] 2 failures in pipeline elasticsearch-pull-request (1.3% fail rate in 150 executions)

Build Scans:

elastic / elasticsearch

[CI] MixedClusterEsqlSpecIT test {categorize.Categorize ASYNC} failing #113721