search

opensearch-project / dashboards-visualizations

Visualize the start, end, and duration of unique events in a sequence in OpenSearch Dashboards
https://opensearch.org/docs/latest/dashboards/gantt/
Apache License 2.0
12 stars 42 forks source link

[ACTION NEEDED] Fix flaky integration tests at distribution level #357

Open gaiksaya opened 5 months ago

gaiksaya commented 5 months ago

What is the bug? It was observed in 2.13.0 and previous other releases that this component manually signed off on the release for failing integration tests. See https://github.com/opensearch-project/opensearch-build/issues/4433#issuecomment-2026486279 The flakiness of the test runs take a lot of time from the release team to collect go/no-go decision and significantly lower the confidence in the release bundles.

How can one reproduce the bug? Steps to reproduce the behavior:

  1. Run integration testing for altering and see the failures.
  2. Issues can be reproduced using the steps declared in AUTOCUT issues for failed integration testing

What is the expected behavior? Tests should be consistently passing.

Do you have any additional context? Please note that this is a hard blocker for 2.14.0 release as per the discussion here

sejli commented 5 months ago

I've had a PR merged in recently to the opensearch-dashboards-functional-test repo that should ideally fix the flaky tests for dashboards-visualizations. I'll keep an eye out for any new failures.

bbarani commented 4 months ago

@sejli Can you please provide your inputs?

sejli commented 4 months ago

Following @ps48's and my PRs to the opensearch-dashboards-functional-test repo, tests have been succeeding since. PRs made:

Thanks @ps48 for the switch back to global tenant.

gaiksaya commented 4 months ago

Adding 2.14.0 release manager @rishabh6788