Open DiannaHohensee opened 11 months ago
Pinging @elastic/es-search (Team:Search)
We have sporadic failures in this test suite that happen a couple times a day so I've muted this in the interim.
Marked as blocker as the entire suite: SearchCancellationIT
is muted.
OK, all the failures started occurring after: https://github.com/elastic/elasticsearch/pull/99689
This is because of concurrent segment search. All these cancellation tests need to rewritten or removed. In the interim, I am going to turn off concurrent search & unmute the tests so we get our coverage back to reduce impact.
unmuting the suite: https://github.com/elastic/elasticsearch/pull/100840
will close this issue once that is merged, if the same test fails again, at least we will have trace logging this time :D.
There is a failure today: https://gradle-enterprise.elastic.co/s/f5csspdznxrxg But I am not sure if the test failed because of the suite timing out, I think so.
Another one: https://gradle-enterprise.elastic.co/s/piu4w3mj3pxtu
Both almost seem like suite timeouts. As they can be explained by an interrupt cancelling the internal waiting threads.
There are some weird things happening in the logs
This will be resolved by https://github.com/elastic/elasticsearch/pull/101777 as well I think
I think I just hit this in a PR build, and I had #101777 in my branch -- https://buildkite.com/elastic/elasticsearch-pull-request/builds/252#018baa9b-a574-41c9-8ff1-789354bda35f
We're going to see this on the 8.11 branch until the fix is backported: https://gradle-enterprise.elastic.co/s/uxcfkx6bwcuxu
Reopening due to recent failure: https://gradle-enterprise.elastic.co/s/wjmkzdeokf6ra
Another one on 8.12: https://gradle-enterprise.elastic.co/s/rlmhdf3txdeu2, muting on 8.12
Pinging @elastic/es-search-foundations (Team:Search Foundations)
Build scan: https://gradle-enterprise.elastic.co/s/pf6k6xm4cpioi/tests/:server:internalClusterTest/org.elasticsearch.search.SearchCancellationIT/testCancelFailedSearchWhenPartialResultDisallowed
Reproduction line:
Applicable branches: main
Reproduces locally?: No
Failure history: https://gradle-enterprise.elastic.co/scans/tests?tests.container=org.elasticsearch.search.SearchCancellationIT&tests.test=testCancelFailedSearchWhenPartialResultDisallowed
Failure excerpt: