opensearch-project / OpenSearch-Dashboards

📊 Open source visualization dashboards for OpenSearch.
https://opensearch.org/docs/latest/dashboards/index/
Apache License 2.0
1.67k stars 874 forks source link

[Test] Flaky bwc test on `main` - `without-security/check_loaded_data.js ` #3376

Open joshuarrrr opened 1 year ago

joshuarrrr commented 1 year ago

Describe the bug

As an effort to make our CI workflows more consistent and reliable, we'll start creating issues for test/workflow failures that resolve when retried.

See https://github.com/opensearch-project/OpenSearch-Dashboards/actions/runs/4074951627/jobs/7030973492

 Running:  without-security/check_loaded_data.js                                           (4 of 5)

  check previously loaded data
    ✓ previous loaded data should exist in dashboards (5725ms)
    Global Flight Dashboard should function properly
      ✓ Global Flight Dashboard is loaded when clicked (14627ms)
      ✓ If set filter for carrier, [Flights] Airline Carrier should show correct carrier (20030ms)
      ✓ If set filter for FlightDelayType, [Flights] Delay Type should filter out selected type (18881ms)
    eCommerce Revenue Dashboard should function properly
      ✓ eCommerce Revenue Dashboard is loaded when clicked (10987ms)
      1) If set filter for gender, [eCommerce] Sales by Gender should show one gender
      ✓ If filter out Women's Clothing, [eCommerce] Sales by Category should not show this category (22087ms)

  6 passing (3m)
  1 failing

  1) check previously loaded data
       eCommerce Revenue Dashboard should function properly
         If set filter for gender, [eCommerce] Sales by Gender should show one gender:
     AssertionError: Timed out retrying after 60000ms: Expected to find element: `[class="label-text"]`, but never found it. Queried from element: <div.visualize.panel-content.panel-content--fullWidth>
      at Context.eval (http://localhost:5601/__cypress/tests?p=cypress/integration/without-security/check_loaded_data.js:154:89)

  (Results)

  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
  │ Tests:        7                                                                                │
  │ Passing:      6                                                                                │
  │ Failing:      1                                                                                │
  │ Pending:      0                                                                                │
  │ Skipped:      0                                                                                │
  │ Screenshots:  1                                                                                │
  │ Video:        true                                                                             │
  │ Duration:     2 minutes, 48 seconds                                                            │
  │ Spec Ran:     without-security/check_loaded_data.js                                            │
  └────────────────────────────────────────────────────────────────────────────────────────────────┘

  (Screenshots)

  -  /__w/OpenSearch-Dashboards/OpenSearch-Dashboards/artifacts/bwc_tmp/test/cypress/     (1280x720)
     screenshots/without-security/check_loaded_data.js/check previously loaded data -               
     - eCommerce Revenue Dashboard should function properly -- If set filter for gend               
     er, [eCommerce] Sales by Gender should show one gender (failed).png                            

  (Video)

  -  Started processing:  Compressing to 32 CRF                                                     
    Compression progress:  37%
    Compression progress:  75%
  -  Finished processing: /__w/OpenSearch-Dashboards/OpenSearch-Dashboards/artifacts/   (30 seconds)
                          bwc_tmp/test/cypress/videos/without-security/check_loaded_d               
                          ata.js.mp4                                                                

    Compression progress:  100%
joshuarrrr commented 1 year ago

another example: 7091398677

joshuarrrr commented 1 year ago

another example: https://github.com/opensearch-project/OpenSearch-Dashboards/actions/runs/4168532471/jobs/7215693152

joshuarrrr commented 1 year ago

another example: https://github.com/opensearch-project/OpenSearch-Dashboards/actions/runs/4146486106/jobs/7172510546

joshuarrrr commented 1 year ago

another example: https://github.com/opensearch-project/OpenSearch-Dashboards/actions/runs/4189322555/jobs/7261878350

joshuarrrr commented 1 year ago

cc @kavilla