[CI] ClientYamlTestSuiteIT test {yaml=cluster.stats/30_ccs_stats/cross-cluster search stats search} failing

elasticsearchmachine commented 3 days ago

Build Scans:

Reproduction Line:

./gradlew ":rest-api-spec:yamlRestTest" --tests "org.elasticsearch.test.rest.ClientYamlTestSuiteIT" -Dtests.method="test {yaml=cluster.stats/30_ccs_stats/cross-cluster search stats search}" -Dtests.seed=D04FF4E8D954FD95 -Dtests.locale=mr-Deva-IN -Dtests.timezone=America/Lima -Druntime.java=22

Applicable branches: main

Reproduces locally?: N/A

Failure History: See dashboard&_a=(controlGroupInput:(chainingSystem:HIERARCHICAL,controlStyle:twoLine,ignoreParentSettings:(ignoreFilters:!f,ignoreQuery:!f,ignoreTimerange:!f,ignoreValidations:!t),panels:('0c0c9cb8-ccd2-45c6-9b13-96bac4abc542':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:task.keyword,grow:!t,id:'0c0c9cb8-ccd2-45c6-9b13-96bac4abc542',searchTechnique:wildcard,selectedOptions:!(),singleSelect:!t,title:'Gradle%20Task',width:medium),grow:!t,order:0,type:optionsListControl,width:small),'144933da-5c1b-4257-a969-7f43455a7901':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:name.keyword,grow:!t,id:'144933da-5c1b-4257-a969-7f43455a7901',searchTechnique:wildcard,selectedOptions:!('test%20%7Byaml%3Dcluster.stats%2F30_ccs_stats%2Fcross-cluster%20search%20stats%20search%7D'),title:Test,width:medium),grow:!t,order:2,type:optionsListControl,width:medium),'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:className.keyword,grow:!t,id:'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850',searchTechnique:wildcard,selectedOptions:!('org.elasticsearch.test.rest.ClientYamlTestSuiteIT'),title:Suite,width:medium),grow:!t,order:1,type:optionsListControl,width:medium)))))

Failure Message:

java.lang.AssertionError: Failure at [cluster.stats/30_ccs_stats:149]: field [ccs._search.clusters.cluster_one.took.max] doesn't have a true value
Expected: not "0"
     but: was "0"

Issue Reasons:

[main] 5 failures in test test {yaml=cluster.stats/30_ccs_stats/cross-cluster search stats search} (2.2% fail rate in 231 executions)
[main] 2 failures in step part-1 (3.8% fail rate in 52 executions)
[main] 2 failures in step rest-compatibility (3.6% fail rate in 56 executions)
[main] 2 failures in pipeline elasticsearch-pull-request (3.2% fail rate in 62 executions)

Note: This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

elasticsearchmachine commented 3 days ago

This has been muted on branch main

Mute Reasons:

[main] 5 failures in test test {yaml=cluster.stats/30_ccs_stats/cross-cluster search stats search} (2.2% fail rate in 231 executions)
[main] 2 failures in step part-1 (3.8% fail rate in 52 executions)
[main] 2 failures in step rest-compatibility (3.6% fail rate in 56 executions)
[main] 2 failures in pipeline elasticsearch-pull-request (3.2% fail rate in 62 executions)

Build Scans:

elasticsearchmachine commented 3 days ago

Pinging @elastic/es-search-relevance (Team:Search Relevance)

elasticsearchmachine commented 3 days ago

Pinging @elastic/es-search-foundations (Team:Search Foundations)

smalyshev commented 2 days ago

Given the rate it may be as simple as true took value just to be less than 1 ms and thus 0? I'll check it anyway.

smalyshev commented 1 day ago

Doesn't seem to reproduce locally with the same seed, which makes me suspect the problem is that some tests may be sub-ms. Will update the checks.

elastic / elasticsearch

[CI] ClientYamlTestSuiteIT test {yaml=cluster.stats/30_ccs_stats/cross-cluster search stats search} failing #114902