[CI] MultiVersionRepositoryAccessIT testCreateAndRestoreSnapshot failing

elasticsearchmachine commented 1 month ago

Build Scans:

Reproduction Line:

./gradlew ":qa:repository-multi-version:v8.15.2#Step1OldClusterTest" -Dtests.class="org.elasticsearch.upgrades.MultiVersionRepositoryAccessIT" -Dtests.method="testReadOnlyRepo" -Dtests.seed=77FC4905466E464C -Dtests.bwc=true -Dtests.locale=fr-GN -Dtests.timezone=Etc/GMT+1 -Druntime.java=22

Applicable branches: main

Reproduces locally?: N/A

Failure History: See dashboard&_a=(controlGroupInput:(chainingSystem:HIERARCHICAL,controlStyle:twoLine,ignoreParentSettings:(ignoreFilters:!f,ignoreQuery:!f,ignoreTimerange:!f,ignoreValidations:!t),panels:('0c0c9cb8-ccd2-45c6-9b13-96bac4abc542':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:task.keyword,grow:!t,id:'0c0c9cb8-ccd2-45c6-9b13-96bac4abc542',searchTechnique:wildcard,selectedOptions:!(),singleSelect:!t,title:'Gradle%20Task',width:medium),grow:!t,order:0,type:optionsListControl,width:small),'144933da-5c1b-4257-a969-7f43455a7901':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:name.keyword,grow:!t,id:'144933da-5c1b-4257-a969-7f43455a7901',searchTechnique:wildcard,selectedOptions:!('testCreateAndRestoreSnapshot'),title:Test,width:medium),grow:!t,order:2,type:optionsListControl,width:medium),'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850':(explicitInput:(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,enhancements:(),fieldName:className.keyword,grow:!t,id:'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850',searchTechnique:wildcard,selectedOptions:!('org.elasticsearch.upgrades.MultiVersionRepositoryAccessIT'),title:Suite,width:medium),grow:!t,order:1,type:optionsListControl,width:medium)))))

Failure Message:

org.elasticsearch.client.WarningFailureException: method [GET], host [http://[::1]:38571], URI [/_rollup/job/_all], status line [HTTP/1.1 200 OK]
Warnings: [The rollup functionality will be removed in in Elasticsearch 9.0. See docs for more information.]
{"jobs":[]}

Issue Reasons:

[main] 9 consecutive failures in step 8.15.2_bwc-snapshots
[main] 4 consecutive failures in pipeline elasticsearch-intake
[main] 9 failures in test testCreateAndRestoreSnapshot (0.9% fail rate in 1000 executions)
[main] 9 failures in step 8.15.2_bwc-snapshots (10.8% fail rate in 83 executions)
[main] 4 failures in pipeline elasticsearch-intake (16.7% fail rate in 24 executions)
[main] 4 failures in pipeline elasticsearch-pull-request (6.1% fail rate in 66 executions)

Note: This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

elasticsearchmachine commented 1 month ago

This has been muted on branch main

Mute Reasons:

[main] 4 consecutive failures in step 8.15.2_bwc-snapshots
[main] 4 failures in test testCreateAndRestoreSnapshot (0.4% fail rate in 1000 executions)
[main] 4 failures in step 8.15.2_bwc-snapshots (5.1% fail rate in 78 executions)
[main] 3 failures in pipeline elasticsearch-pull-request (4.6% fail rate in 65 executions)

Build Scans:

elasticsearchmachine commented 1 month ago

Pinging @elastic/es-distributed (Team:Distributed)

elasticsearchmachine commented 1 month ago

Pinging @elastic/es-storage-engine (Team:StorageEngine)

ywangd commented 1 month ago

There have been a few CI failures (eg https://github.com/elastic/elasticsearch/issues/113069) with the same root cause

org.elasticsearch.client.WarningFailureException: method [GET], host [http://[::1]:38571], URI [/_rollup/job/_all], status line [HTTP/1.1 200 OK]
Warnings: [The rollup functionality will be removed in in Elasticsearch 9.0. See docs for more information.]
{"jobs":[]}

It is not related to the specific test. But rather about the setup and teardown process.

Relabel this to :StorageEngine/Rollup.

elastic / elasticsearch

[CI] MultiVersionRepositoryAccessIT testCreateAndRestoreSnapshot failing #113058