[CI] MlWithSecurityIT class failing

elasticsearchmachine commented 1 month ago

Build Scans:

Reproduction Line:

./gradlew ':x-pack:plugin:ml:qa:ml-with-security:yamlRestTest' --tests "org.elasticsearch.smoketest.MlWithSecurityIT.test {yaml=ml/3rd_party_deployment/Test start deployment fails while model download in progress}" -Dtests.seed=165A3CA6FDCED2F8 -Dtests.locale=fr-PM -Dtests.timezone=SystemV/EST5 -Druntime.java=17

Applicable branches: 8.15

Reproduces locally?: N/A

Failure History: See dashboard&_a=(controlGroupInput:(chainingSystem:HIERARCHICAL,controlStyle:twoLine,ignoreParentSettings:(ignoreFilters:!f,ignoreQuery:!f,ignoreTimerange:!f,ignoreValidations:!t),panels:('0c0c9cb8-ccd2-45c6-9b13-96bac4abc542':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:task.keyword,grow:!t,id:'0c0c9cb8-ccd2-45c6-9b13-96bac4abc542',searchTechnique:wildcard,selectedOptions:!(),singleSelect:!t,title:'Gradle%20Task',width:medium),grow:!t,order:0,type:optionsListControl,width:small),'144933da-5c1b-4257-a969-7f43455a7901':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:name.keyword,grow:!t,id:'144933da-5c1b-4257-a969-7f43455a7901',searchTechnique:wildcard,selectedOptions:!('org.elasticsearch.smoketest.MlWithSecurityIT'),title:Test,width:medium),grow:!t,order:2,type:optionsListControl,width:medium),'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:className.keyword,grow:!t,id:'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850',searchTechnique:wildcard,selectedOptions:!('org.elasticsearch.smoketest.MlWithSecurityIT'),title:Suite,width:medium),grow:!t,order:1,type:optionsListControl,width:medium)))))

Failure Message:

org.elasticsearch.client.ResponseException: method [POST], host [http://127.0.0.1:40289], URI [/_features/_reset], status line [HTTP/1.1 500 Internal Server Error]
{"error":{"root_cause":[{"type":"timeout_exception","reason":"timed out after [30s/30000ms]"}],"type":"failed_node_exception","reason":"Failed node [q--1XRWLRxG0b8-oEEPKEQ]","node_id":"q--1XRWLRxG0b8-oEEPKEQ","caused_by":{"type":"timeout_exception","reason":"timed out after [30s/30000ms]"}},"status":500}

Issue Reasons:

[8.15] 2 consecutive failures in class org.elasticsearch.smoketest.MlWithSecurityIT
[8.15] 8 consecutive failures in step almalinux-8_platform-support-unix
[8.15] 4 consecutive failures in step centos-7_platform-support-unix
[8.15] 3 consecutive failures in step release-tests
[8.15] 3 consecutive failures in step ubuntu-2004_platform-support-unix
[8.15] 6 consecutive failures in step rhel-7_platform-support-unix
[8.15] 4 consecutive failures in step sles-12_platform-support-unix
[8.15] 8 consecutive failures in step ubuntu-2204_platform-support-unix
[8.15] 2 consecutive failures in step rocky-8_platform-support-unix
[8.15] 4 consecutive failures in step rhel-9_platform-support-unix
[8.15] 5 consecutive failures in step debian-11_platform-support-unix
[8.15] 2 consecutive failures in step rhel-8_platform-support-unix
[8.15] 3 consecutive failures in step rocky-9_platform-support-unix
[8.15] 2 consecutive failures in step sles-15_platform-support-unix
[8.15] 120 failures in class org.elasticsearch.smoketest.MlWithSecurityIT (49.2% fail rate in 244 executions)

Note: This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

elasticsearchmachine commented 1 month ago

Pinging @elastic/ml-core (Team:ML)

maxhniebergall commented 1 week ago

These failures only happened from Sept 13-17th. These tests don't seem to be muted. I'm going to close this as it seems to have been fixed.

elastic / elasticsearch

[CI] MlWithSecurityIT class failing #112925