elastic / elasticsearch

Free and Open Source, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
1.03k stars 24.83k forks source link

[CI] XPackRestIT test {p0=transform/transforms_start_stop/Verify start transform reuses destination index} failing #115808

Open elasticsearchmachine opened 1 week ago

elasticsearchmachine commented 1 week ago

Build Scans:

Reproduction Line:

./gradlew ":x-pack:plugin:yamlRestTest" --tests "org.elasticsearch.xpack.test.rest.XPackRestIT.test {p0=transform/transforms_start_stop/Verify start transform reuses destination index}" -Dtests.seed=8042280025D39B59 -Dtests.locale=en-CM -Dtests.timezone=America/El_Salvador -Druntime.java=22

Applicable branches: main

Reproduces locally?: N/A

Failure History: See dashboard&_a=(controlGroupState:(initialChildControlState:('0c0c9cb8-ccd2-45c6-9b13-96bac4abc542':(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,fieldName:task.keyword,order:0,selectedOptions:!(),title:'GradleTask',type:optionsListControl),'4e6ad9d6-6fdc-4fcc-bf1a-aa6ca79e0850':(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,fieldName:className.keyword,order:1,selectedOptions:!(org.elasticsearch.xpack.test.rest.XPackRestIT),title:'Suite',type:optionsListControl),'144933da-5c1b-4257-a969-7f43455a7901':(dataViewId:fbbdc689-be23-4b3d-8057-aa402e9ed0c5,fieldName:name.keyword,order:2,selectedOptions:!(test%20%7Bp0%3Dtransform%2Ftransforms_start_stop%2FVerify%20start%20transform%20reuses%20destination%20index%7D),title:'Test',type:optionsListControl)))))

Failure Message:

java.lang.AssertionError: Failure at [transform/transforms_start_stop:201]: expected [2xx] status code but api [transform.start_transform] returned [408 Request Timeout] [{"error":{"root_cause":[{"type":"status_exception","reason":"Starting transform [airline-transform-start-stop] timed out after [30s]","stack_trace":"org.elasticsearch.ElasticsearchStatusException: Starting transform [airline-transform-start-stop] timed out after [30s]\n\tat org.elasticsearch.transform@9.0.0-SNAPSHOT/org.elasticsearch.xpack.transform.action.TransportStartTransformAction$2.onTimeout(TransportStartTransformAction.java:353)\n\tat org.elasticsearch.server@9.0.0-SNAPSHOT/org.elasticsearch.persistent.PersistentTasksService$1.onTimeout(PersistentTasksService.java:206)\n\tat org.elasticsearch.server@9.0.0-SNAPSHOT/org.elasticsearch.cluster.ClusterStateObserver$ContextPreservingListener.onTimeout(ClusterStateObserver.java:390)\n\tat org.elasticsearch.server@9.0.0-SNAPSHOT/org.elasticsearch.cluster.ClusterStateObserver$ObserverClusterStateListener.onTimeout(ClusterStateObserver.java:303)\n\tat org.elasticsearch.server@9.0.0-SNAPSHOT/org.elasticsearch.cluster.service.ClusterApplierService$NotifyTimeout.run(ClusterApplierService.java:650)\n\tat org.elasticsearch.server@9.0.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:956)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1570)\n"}],"type":"status_exception","reason":"Starting transform [airline-transform-start-stop] timed out after [30s]","stack_trace":"org.elasticsearch.ElasticsearchStatusException: Starting transform [airline-transform-start-stop] timed out after [30s]\n\tat org.elasticsearch.transform@9.0.0-SNAPSHOT/org.elasticsearch.xpack.transform.action.TransportStartTransformAction$2.onTimeout(TransportStartTransformAction.java:353)\n\tat org.elasticsearch.server@9.0.0-SNAPSHOT/org.elasticsearch.persistent.PersistentTasksService$1.onTimeout(PersistentTasksService.java:206)\n\tat org.elasticsearch.server@9.0.0-SNAPSHOT/org.elasticsearch.cluster.ClusterStateObserver$ContextPreservingListener.onTimeout(ClusterStateObserver.java:390)\n\tat org.elasticsearch.server@9.0.0-SNAPSHOT/org.elasticsearch.cluster.ClusterStateObserver$ObserverClusterStateListener.onTimeout(ClusterStateObserver.java:303)\n\tat org.elasticsearch.server@9.0.0-SNAPSHOT/org.elasticsearch.cluster.service.ClusterApplierService$NotifyTimeout.run(ClusterApplierService.java:650)\n\tat org.elasticsearch.server@9.0.0-SNAPSHOT/org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:956)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1570)\n"},"status":408}]

Issue Reasons:

Note: This issue was created using new test triage automation. Please report issues or feedback to es-delivery.

elasticsearchmachine commented 1 week ago

This has been muted on branch main

Mute Reasons:

Build Scans:

elasticsearchmachine commented 1 week ago

Pinging @elastic/es-search-relevance (Team:Search Relevance)

elasticsearchmachine commented 1 week ago

Pinging @elastic/ml-core (Team:ML)

maxhniebergall commented 1 week ago

@prwhelan, this seems like a super rare problem, and it's just a timeout. Maybe we should try increasing the timeout to avoid the flakiness?

maxhniebergall commented 1 week ago

I'm marking this as low risk since it is so rare, but being muted is risky.