elastic / elasticsearch

Free and Open Source, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
870 stars 24.81k forks source link

[CI] EsqlAsyncSecurityIT testIndexPatternErrorMessageComparison_ESQL_SearchDSL failing #112630

Closed elasticsearchmachine closed 1 day ago

elasticsearchmachine commented 1 month ago

Build Scans:

Reproduction Line:

./gradlew ":x-pack:plugin:esql:qa:security:javaRestTest" --tests "org.elasticsearch.xpack.esql.EsqlAsyncSecurityIT.testIndexPatternErrorMessageComparison_ESQL_SearchDSL" -Dtests.seed=A4DEB6912639A125 -Dtests.locale=zu-Latn-ZA -Dtests.timezone=Etc/GMT+11 -Druntime.java=17

Applicable branches: main

Reproduces locally?: N/A

Failure History: See dashboard&_a=(controlGroupInput:(chainingSystem:HIERARCHICAL,controlStyle:twoLine,ignoreParentSettings:(ignoreFilters:!f,ignoreQuery:!f,ignoreTimerange:!f,ignoreValidations:!t),panels:('0c0c9cb8-ccd2-45c6-9b13-96bac4abc542':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:task.keyword,grow:!t,id:'0c0c9cb8-ccd2-45c6-9b13-96bac4abc542',searchTechnique:wildcard,selectedOptions:!(),singleSelect:!t,title:'Gradle%20Task',width:medium),grow:!t,order:0,type:optionsListControl,width:small),'144933da-5c1b-4257-a969-7f43455a7901':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:name.keyword,grow:!t,id:'144933da-5c1b-4257-a969-7f43455a7901',searchTechnique:wildcard,selectedOptions:!('testIndexPatternErrorMessageComparison_ESQL_SearchDSL'),title:Test,width:medium),grow:!t,order:2,type:optionsListControl,width:medium),'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:className.keyword,grow:!t,id:'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850',searchTechnique:wildcard,selectedOptions:!('org.elasticsearch.xpack.esql.EsqlAsyncSecurityIT'),title:Suite,width:medium),grow:!t,order:1,type:optionsListControl,width:medium)))))

Failure Message:

java.lang.AssertionError: 
Expected: a string containing "unauthorized for user [test-admin] run as [metadata1_read2] with effective roles [metadata1_read2] on indices [index-user1]"
     but: was "{"error":{"root_cause":[{"type":"illegal_index_shard_state_exception","reason":"CurrentState[RECOVERING] operations only allowed when shard state is one of [POST_RECOVERY, STARTED]","index_uuid":"zG_xj76fQv6maF6hSbFWUQ","shard":"0","index":".async-search","stack_trace":"[.async-search/zG_xj76fQv6maF6hSbFWUQ][[.async-search][0]] org.elasticsearch.index.shard.IllegalIndexShardStateException: CurrentState[RECOVERING] operations only allowed when shard state is one of [POST_RECOVERY, STARTED]\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.shard.IndexShard.readAllowed(IndexShard.java:2303)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.shard.IndexShard.innerGet(IndexShard.java:1269)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.shard.IndexShard.get(IndexShard.java:1242)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.get.ShardGetService.innerGet(ShardGetService.java:270)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.get.ShardGetService.get(ShardGetService.java:144)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.get.ShardGetService.get(ShardGetService.java:91)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.get.TransportGetAction.shardOperation(TransportGetAction.java:151)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.get.TransportGetAction.shardOperation(TransportGetAction.java:55)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.support.single.shard.TransportSingleShardAction.lambda$asyncShardOperation$0(TransportSingleShardAction.java:113)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.ActionRunnable$3.accept(ActionRunnable.java:78)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.ActionRunnable$3.accept(ActionRunnable.java:75)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.ActionRunnable$4.doRun(ActionRunnable.java:100)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:991)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:26)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:833)\n"}],"type":"no_shard_available_action_exception","reason":"No shard available for [get [.async-search][-5ztzQ5zRSaAMWfbYkWilA]: routing [null]]","caused_by":{"type":"illegal_index_shard_state_exception","reason":"CurrentState[RECOVERING] operations only allowed when shard state is one of [POST_RECOVERY, STARTED]","index_uuid":"zG_xj76fQv6maF6hSbFWUQ","shard":"0","index":".async-search","stack_trace":"[.async-search/zG_xj76fQv6maF6hSbFWUQ][[.async-search][0]] org.elasticsearch.index.shard.IllegalIndexShardStateException: CurrentState[RECOVERING] operations only allowed when shard state is one of [POST_RECOVERY, STARTED]\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.shard.IndexShard.readAllowed(IndexShard.java:2303)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.shard.IndexShard.innerGet(IndexShard.java:1269)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.shard.IndexShard.get(IndexShard.java:1242)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.get.ShardGetService.innerGet(ShardGetService.java:270)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.get.ShardGetService.get(ShardGetService.java:144)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.get.ShardGetService.get(ShardGetService.java:91)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.get.TransportGetAction.shardOperation(TransportGetAction.java:151)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.get.TransportGetAction.shardOperation(TransportGetAction.java:55)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.support.single.shard.TransportSingleShardAction.lambda$asyncShardOperation$0(TransportSingleShardAction.java:113)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.ActionRunnable$3.accept(ActionRunnable.java:78)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.ActionRunnable$3.accept(ActionRunnable.java:75)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.ActionRunnable$4.doRun(ActionRunnable.java:100)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:991)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:26)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:833)\n"},"stack_trace":"org.elasticsearch.action.NoShardAvailableActionException: No shard available for [get [.async-search][-5ztzQ5zRSaAMWfbYkWilA]: routing [null]]\nCaused by: org.elasticsearch.transport.RemoteTransportException: [test-cluster-0][127.0.0.1:43823][indices:data/read/get[s]]\nCaused by: [.async-search/zG_xj76fQv6maF6hSbFWUQ][[.async-search][0]] org.elasticsearch.index.shard.IllegalIndexShardStateException: CurrentState[RECOVERING] operations only allowed when shard state is one of [POST_RECOVERY, STARTED]\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.shard.IndexShard.readAllowed(IndexShard.java:2303)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.shard.IndexShard.innerGet(IndexShard.java:1269)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.shard.IndexShard.get(IndexShard.java:1242)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.get.ShardGetService.innerGet(ShardGetService.java:270)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.get.ShardGetService.get(ShardGetService.java:144)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.index.get.ShardGetService.get(ShardGetService.java:91)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.get.TransportGetAction.shardOperation(TransportGetAction.java:151)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.get.TransportGetAction.shardOperation(TransportGetAction.java:55)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.support.single.shard.TransportSingleShardAction.lambda$asyncShardOperation$0(TransportSingleShardAction.java:113)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.ActionRunnable$3.accept(ActionRunnable.java:78)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.ActionRunnable$3.accept(ActionRunnable.java:75)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.action.ActionRunnable$4.doRun(ActionRunnable.java:100)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:991)\n\tat org.elasticsearch.server@8.16.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:26)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:833)\n"},"status":503}"

Issue Reasons:

Note: This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

elasticsearchmachine commented 1 month ago

This has been muted on branch main

Mute Reasons:

Build Scans:

elasticsearchmachine commented 1 month ago

Pinging @elastic/es-analytical-engine (Team:Analytics)

alex-spies commented 1 month ago

@astefan I think this is related to https://github.com/elastic/elasticsearch/pull/111797, do you want to take a look?

I think it's low risk because the test cluster ended up being in an unexpected state that is unrelated to what is being tested, and the error message is not the expected one but still okay since the associated REST response status for this kind of exception is 404.

elasticsearchmachine commented 1 day ago

This issue has been closed because it has been open for too long with no activity.

Any muted tests that were associated with this issue have been unmuted.

If the tests begin failing again, a new issue will be opened, and they may be muted again.