[CI] LicenseDLSFLSRoleIT testQueryDLSFLSRolesShowAsDisabled failing

[elasticsearchmachine]

Build Scans:

• elasticsearch-periodic-platform-support #3617 / windows-2022_checkpart4_platform-support-windows
• elasticsearch-periodic-platform-support #3577 / windows-2016_checkpart4_platform-support-windows

Reproduction Line:

gradlew ':x-pack:plugin:security:qa:security-basic:javaRestTest' --tests "org.elasticsearch.xpack.security.LicenseDLSFLSRoleIT.testQueryDLSFLSRolesShowAsDisabled" -Dtests.seed=BAF736A5E425FF9D -Dtests.locale=fi -Dtests.timezone=America/Indiana/Winamac -Druntime.java=22

Applicable branches: 8.15

Reproduces locally?: N/A

Failure History: See dashboard&_a=(controlGroupInput:(chainingSystem:HIERARCHICAL,controlStyle:twoLine,ignoreParentSettings:(ignoreFilters:!f,ignoreQuery:!f,ignoreTimerange:!f,ignoreValidations:!t),panels:('0c0c9cb8-ccd2-45c6-9b13-96bac4abc542':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:task.keyword,grow:!t,id:'0c0c9cb8-ccd2-45c6-9b13-96bac4abc542',searchTechnique:wildcard,selectedOptions:!(),singleSelect:!t,title:'Gradle%20Task',width:medium),grow:!t,order:0,type:optionsListControl,width:small),'144933da-5c1b-4257-a969-7f43455a7901':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:name.keyword,grow:!t,id:'144933da-5c1b-4257-a969-7f43455a7901',searchTechnique:wildcard,selectedOptions:!('testQueryDLSFLSRolesShowAsDisabled'),title:Test,width:medium),grow:!t,order:2,type:optionsListControl,width:medium),'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:className.keyword,grow:!t,id:'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850',searchTechnique:wildcard,selectedOptions:!('org.elasticsearch.xpack.security.LicenseDLSFLSRoleIT'),title:Suite,width:medium),grow:!t,order:1,type:optionsListControl,width:medium)))))

Failure Message:

java.lang.AssertionError: license not yet installed

Issue Reasons:

• [8.15] 2 failures in test testQueryDLSFLSRolesShowAsDisabled (0.6% fail rate in 317 executions)
• [8.15] 2 failures in pipeline elasticsearch-periodic-platform-support (18.2% fail rate in 11 executions)

Note: This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

[elasticsearchmachine]

This has been muted on branch main

Mute Reasons:

• [main] 9 failures in test testQueryDLSFLSRolesShowAsDisabled (0.9% fail rate)
• [main] 6 failures in step part-4 (2.0% fail rate)
• [main] 6 failures in pipeline elasticsearch-pull-request (2.0% fail rate)
• [main] 2.0% failure rate in step part-4 (2.0% fail rate)
• [main] 2.0% failure rate in pipeline elasticsearch-pull-request (2.0% fail rate)

Build Scans:

• elasticsearch-intake #8111 / part4
• elasticsearch-pull-request #25452 / part-4
• elasticsearch-intake #8069 / part4
• elasticsearch-pull-request #25167 / part-4
• elasticsearch-pull-request #24835 / part-4
• elasticsearch-pull-request #24788 / part-4
• elasticsearch-pull-request #24753 / part-4
• elasticsearch-periodic-platform-support #3263 / windows-2016_checkpart4_platform-support-windows
• elasticsearch-pull-request #24663 / part-4

[elasticsearchmachine]

Pinging @elastic/es-security (Team:Security)

[jfreden]

Looks like a test infrastructure issue. Sometimes the waitForLicense returns 404 for more than 10 seconds. We have other tests doing this with success so not sure why it's failing. @albertzaharovits this is the new license test suite added for query roles.

[jfreden]

Fixed in: https://github.com/elastic/elasticsearch/pull/112002