search

opensearch-project / OpenSearch

🔎 Open source distributed and RESTful search engine.
https://opensearch.org/docs/latest/opensearch/index/
Apache License 2.0
8.89k stars 1.63k forks source link

[Draft] Query Insight Plugin with Top Queries feature #11506

Closed ansjcy closed 2 months ago

ansjcy commented 5 months ago

Description

(parent RFC: https://github.com/opensearch-project/OpenSearch/issues/11186) This PR implements the basic query insight framework and the "top N queries by latency" feature using this generic framework. More specifically, this PR includes:

How to use the API:

  1. First enable the top N queries insight feature

    curl -X PUT 'localhost:9200/_cluster/settings' -H 'Content-Type: application/json' -d'
{
"persistent" : {
    "search.insights.top_queries.latency.enabled" : "true",
    "search.insights.top_queries.latency.window_size" : "60s",
    "search.insights.top_queries.latency.top_n_size" : 5
}
}'

  2. Insert documents for searching

    curl -X POST "localhost:9200/my-index-0/_doc/?pretty" -H 'Content-Type: application/json' -d'
{
"@timestamp": "2023-12-01T13:12:00",
"message": "this is my document",
"user": {
"id": "ansjcy"
}
}'

  3. Do some search operations

    curl -X GET "localhost:9200/my-index-0/_search?size=20&pretty" -H 'Content-Type: application/json' -d'
{
"query": {
"bool": {
  "must": [
    {
      "match_phrase": {
        "message": "document 2"
      }
    },
    {
      "match": {
        "user.id": "cyji"
      }
    }
  ]
}
}
}'
curl -X GET "localhost:9200/my-index-0/_search?size=20&pretty" -H 'Content-Type: application/json' -d '{}'
...

  4. Get top N queries by latency in the last 1 minute

    curl -X GET "localhost:9200/_insights/top_queries?type=latency&pretty"

    returns

    {
"top_queries" : [
{
  "timestamp" : 1706746069075,
  "phase_latency_map" : {
    "expand" : 0,
    "query" : 36,
    "fetch" : 2
  },
  "node_id" : "PsQkEubhT9S-ePsh906t-w",
  "total_shards" : 1,
  "search_type" : "query_then_fetch",
  "source" : "{\"size\":20,\"query\":{\"bool\":{\"must\":[{\"match_phrase\":{\"message\":{\"query\":\"document 2\",\"slop\":0,\"zero_terms_query\":\"NONE\",\"boost\":1.0}}},{\"match\":{\"user.id\":{\"query\":\"cyji\",\"operator\":\"OR\",\"prefix_length\":0,\"max_expansions\":50,\"fuzzy_transpositions\":true,\"lenient\":false,\"zero_terms_query\":\"NONE\",\"auto_generate_synonyms_phrase_query\":true,\"boost\":1.0}}}],\"adjust_pure_negative\":true,\"boost\":1.0}}}",
  "indices" : [
    "my-index-0"
  ],
  "latency" : 45
},
{
  "timestamp" : 1706746069271,
  "total_shards" : 1,
  "search_type" : "query_then_fetch",
  "source" : "{\"size\":20}",
  "phase_latency_map" : {
    "expand" : 0,
    "query" : 19,
    "fetch" : 0
  },
  "indices" : [
    "my-index-0"
  ],
  "node_id" : "IITrLUUXROCQehphz75Jsw",
  "latency" : 20
},
{
  "timestamp" : 1706746069135,
  "total_shards" : 1,
  "search_type" : "query_then_fetch",
  "source" : "{\"size\":20}",
  "phase_latency_map" : {
    "expand" : 0,
    "query" : 10,
    "fetch" : 2
  },
  "indices" : [
    "my-index-0"
  ],
  "node_id" : "IITrLUUXROCQehphz75Jsw",
  "latency" : 18
},
{
  "timestamp" : 1706746069351,
  "total_shards" : 1,
  "search_type" : "query_then_fetch",
  "source" : "{\"size\":20}",
  "phase_latency_map" : {
    "expand" : 0,
    "query" : 2,
    "fetch" : 1
  },
  "indices" : [
    "my-index-0"
  ],
  "node_id" : "_2E2035ZQvmEM9GMADl9Bw",
  "latency" : 9
},
{
  "timestamp" : 1706746069380,
  "total_shards" : 1,
  "search_type" : "query_then_fetch",
  "source" : "{\"size\":20}",
  "phase_latency_map" : {
    "expand" : 0,
    "query" : 5,
    "fetch" : 0
  },
  "indices" : [
    "my-index-0"
  ],
  "node_id" : "_2E2035ZQvmEM9GMADl9Bw",
  "latency" : 6
}
]
}

Load Tests

~70 Load tests are performed using the nyc_taxis workload on different combinations of window sizes and top n values. No performance impact identified. Here are detailed benchmark results.

Feature off (Baseline)

Runs 50th percentile 90th percentile latency 99th percentile latency 100th percentile latency
1 (2110) 5.68534 6.27264 6.73714 8.4323
2 (bc5e) 5.36776 5.80834 6.50946 28.6724
3 (bcdb) 5.18429 5.60393 9.2652 30.4254
4 (d74f) 5.02313 5.74386 6.7693 9.38909
5 (9244) 5.10541 5.47246 7.84308 8.63438
6 (b1de) 5.14018 5.49457 6.75883 9.80746
7 (217e) 5.09886 5.56152 8.21575 18.4278
8 (57d3) 5.26441 5.83722 9.92809 15.4894
9 (78f3) 5.30425 5.76678 9.24641 30.7725
10 (a2d6) 5.30458 5.82973 8.86554 13.9551
Median 5.22435 5.75532 8.02942 14.72225
Mean 5.24782 5.73911 8.01388 17.40058
St dev 0.18888 0.23304 1.272 9.25685

n=10, window size = 10 minutes

Runs 50th percentile 90th percentile latency 99th percentile latency 100th percentile latency
1 (2110) 5.48015 5.93038 6.35181 8.1288
2 (bc5e) 5.12966 5.52368 6.05926 7.25804
3 (bcdb) 5.17215 5.66219 6.65964 7.45862
4 (d74f) 4.90608 5.57437 6.04869 7.64221
5 (9244) 5.49047 5.89037 6.41805 7.67218
6 (b1de) 5.06197 5.42041 6.89302 16.4436
7 (217e) 5.27588 5.63697 6.48004 8.57925
8 (57d3) 4.85925 5.20557 6.20037 8.81262
9 (78f3) 5.3572 5.81061 8.37155 14.7513
10 (a2d6) 5.53084 6.26242 8.44923 17.5828
Median 5.22401 5.64958 6.44905 8.35403
Mean 5.22636 5.6917 6.79317 10.43294
St dev 0.24109 0.29666 0.89066 4.10425

n=50, window size = 10 minutes

Runs 50th percentile 90th percentile latency 99th percentile latency 100th percentile latency
1 (2110) 5.3265 5.76359 6.50887 8.87379
2 (bc5e) 5.15597 5.76559 6.26947 7.86013
3 (bcdb) 5.58544 6.05801 9.65796 15.5788
4 (d74f) 5.00877 5.44595 6.14539 9.64201
5 (9244) 5.39437 5.7242 6.42808 9.3807
6 (b1de) 4.99536 5.23857 5.80347 8.70772
7 (217e) 5.26149 5.76495 9.92437 18.695
8 (57d3) 5.19225 5.59769 5.82104 6.70231
9 (78f3) 5.28367 5.7321 6.18476 8.3956
10 (a2d6) 5.38787 5.97278 6.90825 7.99288
Median 5.27258 5.74785 6.34878 8.79076
Mean 5.25917 5.70634 6.96517 10.18289
St dev 0.1807 0.23671 1.52503 3.82823

n=100, window size = 10 minutes

Runs 50th percentile 90th percentile latency 99th percentile latency 100th percentile latency
1 (2110) 5.42979 5.88745 8.21798 13.2944
2 (bc5e) 5.05335 6.07895 7.3364 9.17266
3 (bcdb) 5.41622 5.76504 6.77248 7.78023
4 (d74f) 4.79577 5.26539 5.69491 7.45989
5 (9244) 5.20676 5.57206 8.1644 18.6386
6 (b1de) 4.43616 5.02934 16.3021 18.167
7 (217e) 5.30738 5.75768 6.37761 8.36801
8 (57d3) 4.93365 5.59796 7.23298 30.6488
9 (78f3) 5.38238 5.8045 6.63352 9.21911
10 (a2d6) 5.314 5.84568 8.70836 28.0179
Median 5.25707 5.76136 7.28469 11.25676
Mean 5.12755 5.66041 8.14407 15.07666
St dev 0.3239 0.31059 3.01186 8.56873

n=10, window size = 60 minutes

Runs 50th percentile 90th percentile latency 99th percentile latency 100th percentile latency
1 (2110) 5.48994 5.82642 9.2272 14.1245
2 (bc5e) 5.10504 5.70799 7.26535 10.31651
3 (bcdb) 5.20354 5.79872 8.79294 16.5674
4 (d74f) 5.34996 5.96373 6.80488 10.5772
5 (9244) 5.05346 5.62933 6.0651 8.00097
6 (b1de) 4.92265 5.42617 5.97952 7.94773
7 (217e) 5.20606 5.68424 8.25867 12.8365
8 (57d3) 5.04032 5.7306 6.50287 9.94117
9 (78f3) 5.22669 5.77208 6.68624 8.57578
10 (a2d6) 5.3514 6.00356 6.46163 8.47628
Median 5.2048 5.75134 6.74556 10.12884
Mean 5.19491 5.75428 7.20444 10.7364
St dev 0.17091 0.16478 1.15473 2.90134

n=50, window size = 60 minutes

Runs 50th percentile 90th percentile latency 99th percentile latency 100th percentile latency
1 (2110) 5.66053 6.09658 10.03 16.7627
2 (bc5e) 5.17521 5.65421 8.03381 35.3631
3 (bcdb) 5.18126 5.70204 8.7235 31.0266
4 (d74f) 4.8835 5.13923 5.81303 9.60856
5 (9244) 5.38711 5.87948 6.43249 8.73293
6 (b1de) 4.73117 5.16525 5.63382 6.48858
7 (217e) 5.22232 5.66381 6.4244 6.79487
8 (57d3) 4.86784 5.3733 6.11748 8.90142
9 (78f3) 5.38244 5.89673 9.13197 28.2333
10 (a2d6) 5.53817 5.93063 8.72938 31.9991
Median 5.20179 5.68293 7.23315 13.18563
Mean 5.20296 5.65013 7.50699 18.39112
St dev 0.30303 0.3278 1.5949 11.8744

n=100, window size = 60 minutes

Runs 50th percentile 90th percentile latency 99th percentile latency 100th percentile latency
1 (2110) 5.61482 6.16978 9.96055 26.959
2 (bc5e) 4.80904 5.14862 6.18893 16.3675
3 (bcdb) 5.23928 5.77383 6.16525 8.2151
4 (d74f) 4.91612 5.31431 6.05033 9.32068
5 (9244) 5.43572 5.90742 8.29484 14.3912
6 (b1de) 4.8768 5.26618 5.81323 7.71826
7 (217e) 5.31596 5.80771 8.0518 33.2195
8 (57d3) 4.91712 5.31075 8.97082 28.1725
9 (78f3) 5.28335 5.62963 9.44923 12.0019
10 (a2d6) 5.48454 6.06844 6.63467 8.84661
Median 5.26132 5.70173 7.34324 13.19655
Mean 5.18928 5.63967 7.55797 16.52123
St dev 0.28816 0.36172 1.56758 9.4619

Related Issues

Resolves #11295 #11296

Check List

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. For more information on following Developer Certificate of Origin and signing off your commits, please check here.

github-actions[bot] commented 5 months ago

:x: Gradle check result for 346eb169dd2dd31293f6ff5c496cc4dac1f41b46: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 5 months ago

:x: Gradle check result for 1f3092e9569d92a156e4b3fb9760496e2bd3496d: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 5 months ago

Compatibility status:

Checks if related components are compatible with change fba0556

Incompatible components

Incompatible components: [https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/performance-analyzer.git]

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/custom-codecs.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/flow-framework.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/opensearch-oci-object-storage.git, https://github.com/opensearch-project/security-analytics.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/sql.git]

github-actions[bot] commented 5 months ago

:x: Gradle check result for c9caa80c9bdf5e0f4b103ecf05b080a2a5fefa4c: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

rishabhmaurya commented 5 months ago

Thanks @ansjcy for working on it. The whole code should be part of a plugin and not the server module. Is there anything you depend on here which isn't pluggable?

ansjcy commented 5 months ago

Thanks @ansjcy for working on it. The whole code should be part of a plugin and not the server module. Is there anything you depend on here which isn't pluggable?

Hey @rishabhmaurya ! Yes, this whole code will eventually be moved to a QueryInsight plugin . The blocker right now is https://github.com/opensearch-project/OpenSearch/issues/11520.

I'm working on resolving that blocker right now in https://github.com/opensearch-project/OpenSearch/pull/11526

github-actions[bot] commented 5 months ago

:x: Gradle check result for 0c64c4225e219b7706f5ca277da79bbd1f04aaee: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 5 months ago

:x: Gradle check result for b082ae1b9ff25bec3c2afe25787785d8687370d7: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 5 months ago

:x: Gradle check result for df64213f8694174fcc2214d46d0984552c324ea4: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 5 months ago

:x: Gradle check result for 03a5166bccf6ba0c63d295b03fa6ba8cd10cf5e4: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 5 months ago

:x: Gradle check result for 4d1cdc22d56e6fdf05196707e8180cac6836443c: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 5 months ago

:x: Gradle check result for ae0fd5d90b5ea38383e9dac2c1e3ce073ab284bd: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for a19c7896725ab384e082f71d5037727f0072436c: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for b2d864733230831ece8d0a09e7489f1591e24b77: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for ab2453bff0c4c95ab84a4e8c2645b78b41c0469f: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for 93f63b36bb5d639529cb9d15799cfaf1d2bbb4d8: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for d69ca78c652ab6c0f520e55e49bd1aef48977203: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

deshsidd commented 4 months ago

Had to submit partial review since I got a notification that the changes I am reviewing are stale (looks like you just added another commit). Still reviewing... cc @ansjcy

github-actions[bot] commented 4 months ago

:white_check_mark: Gradle check result for 1f7af1a3de372ebe14632612bb674a36d285a58c: SUCCESS

codecov[bot] commented 4 months ago

Codecov Report

Attention: Patch coverage is 73.57513% with 102 lines in your changes are missing coverage. Please review.

Project coverage is 71.39%. Comparing base (a8dd6a0) to head (fba0556). Report is 96 commits behind head on main.

Files Patch % Lines
...ansport/top_queries/TransportTopQueriesAction.java 24.00% 18 Missing and 1 partial :warning:
...in/insights/core/service/QueryInsightsService.java 62.50% 12 Missing and 6 partials :warning:
.../insights/core/listener/QueryInsightsListener.java 73.58% 10 Missing and 4 partials :warning:
...plugin/insights/rules/model/SearchQueryRecord.java 76.74% 4 Missing and 6 partials :warning:
.../resthandler/top_queries/RestTopQueriesAction.java 44.44% 10 Missing :warning:
...lugin/insights/core/service/TopQueriesService.java 87.67% 4 Missing and 5 partials :warning:
.../insights/rules/action/top_queries/TopQueries.java 66.66% 5 Missing :warning:
...search/plugin/insights/rules/model/MetricType.java 77.77% 2 Missing and 2 partials :warning:
...opensearch/action/search/SearchRequestSlowLog.java 0.00% 4 Missing :warning:
...pensearch/plugin/insights/QueryInsightsPlugin.java 66.66% 3 Missing :warning:
... and 3 more
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #11506 +/- ## ============================================ + Coverage 71.26% 71.39% +0.12% - Complexity 59413 59637 +224 ============================================ Files 4927 4951 +24 Lines 279662 280490 +828 Branches 40656 40737 +81 ============================================ + Hits 199311 200253 +942 + Misses 63725 63569 -156 - Partials 16626 16668 +42 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

deshsidd commented 4 months ago

Awesome work @ansjcy and thanks for adding the exhaustive unit and integration tests. This was a really long PR to review. Excited to have this merged and in use 👍

Looks like the code coverage is failing for the tests. We might need to add some more tests to fix this?

github-actions[bot] commented 4 months ago

:x: Gradle check result for 9480e7d89b19b5a3c1cdad4351d9443d9ef24d57: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for d60f9b64b0f0b128120ff360a8d849329e2f8d53: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for f1751799f47b87b6837189be4e01b91e15befd47: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

deshsidd commented 4 months ago

Lets have a max/min allowed time for the window (1 minute to 1 hour based on our discussion in the meeting)?

deshsidd commented 4 months ago

If no type is provided for GET Top queries api, should we aim to provide topN for all types (Latency, CPU, etc) rather than defaulting to latency? Or for now we can default to latency since its the only one we have and tweak this in the long term when we add more topN?

jainankitk commented 4 months ago

@ansjcy - Maybe I am jumping in too late, but this single PR is doing many things. May I suggest breaking this into more reviewable chunks? I could see 3 major components:

The settings for window size and number of queries can go into either 2 or 3 PR.

ansjcy commented 4 months ago

If no type is provided for GET Top queries api, should we aim to provide topN for all types (Latency, CPU, etc) rather than defaulting to latency? Or for now we can default to latency since its the only one we have and tweak this in the long term when we add more topN?

We already have the default type as Latency defined in the current code. For the first phase, let's not change the scope and aim at Latency as the first metric.

ansjcy commented 4 months ago

@ansjcy - Maybe I am jumping in too late, but this single PR is doing many things. May I suggest breaking this into more reviewable chunks? I could see 3 major components:

  • Introduction of Query Insights plugin, along with the service
  • Functionality of Top N latency tracking, along with the service
  • API for viewing the top queries

The settings for window size and number of queries can go into either 2 or 3 PR.

Thanks for the feedback! Logically the Top N Latency Tracking service should go together with the API definations since they are tightly correlated. Let me see if I can break this PR into 2 to make it more reviewable.

github-actions[bot] commented 4 months ago

:x: Gradle check result for b0fd5d2268ac75f016beadb6cb601b19dd3ae617: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for e70009d430d2b04ddf5165c5042b3e860e467e1a: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for 9ec5266013b99f40ce39fa0e16ab5dfcebf7ac09: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:white_check_mark: Gradle check result for 1d68aab49ffcb22db3166b36721ad40f9518dfd7: SUCCESS

github-actions[bot] commented 4 months ago

:x: Gradle check result for 620560f4f7e70fe0295e8f96eb9b7ce841342cc8: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for bb90f8afb928e067e004f9060a1264e0efec601f: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for cbccbc2d50787c5e8884f0ab4ade3cc61d8830d9: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for 2784b679c177750d1dc67cc39a7739761791804e: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for e2c15ba955572e24839ff8dc868a337ce511615c: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for 33fbda76f686f6bdcb8ddd90bfa707ea7e984957: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for a628089a55a7ff41330c741f6b23e8e01bbcf21b: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for b33ef50a97dcb3e1e460000dced77d085c8ade26: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for ddec7a2e8f0a5b2496221e7a2430406cc0400bce: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:grey_exclamation: Gradle check result for 5c4695575ebb5a6f98ad786013d9706e3f3f7cba: UNSTABLE

Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

github-actions[bot] commented 4 months ago

:white_check_mark: Gradle check result for 46ce6e8434b36f60338fbde7c30a72ea82b7b386: SUCCESS

github-actions[bot] commented 4 months ago

:white_check_mark: Gradle check result for 2cf290c84844def16d190dafb0648201700eadf2: SUCCESS

github-actions[bot] commented 4 months ago

:x: Gradle check result for a2bbedf1022ba9e04d1a0a6c2f1f7ad209c242a6: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for c590dd53057e9c03d467567c71ab6b51a94feaae: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for 80c3c570725f9089dc288d2560b74d30be9872b8: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for aa3cb94e7ddecae09b878e96e9146b024deba957: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

github-actions[bot] commented 4 months ago

:x: Gradle check result for 2e13df6cc44ec339ed8f3c86fe061abc5b08a776: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?