elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.68k stars 8.23k forks source link

Failing serverless feature flag test suites - x-pack/test_serverless/functional/test_suites/observability/infra #191809

Open pheyos opened 2 months ago

pheyos commented 2 months ago

We had some disabled serverless feature flag configurations, which resulted in corresponding tests not running on PRs / on-merge. After enabling these configs in #191755, we noticed that this test actually fails. Since the test never ran, it's unclear whether it was failing from the start or is just outdated. The test suite will be skipped as part of that PR and should be fixed and re-enabled.

Failure details

x-pack/test_serverless/functional/test_suites/observability/infra/header_menu.ts serverless observability UI - feature flags Observability Infra Header menu Alerts dropdown is hidden

TimeoutError: The element [data-test-subj="infrastructure-alerts-and-rules"] was still present when it should have disappeared.
Wait timed out after 2519ms
    at /opt/buildkite-agent/builds/bk-agent-prod-gcp-1724948847736785378/elastic/kibana-pull-request/kibana/node_modules/selenium-webdriver/lib/webdriver.js:913:22
    at processTicksAndRejections (node:internal/process/task_queues:95:5) {
  remoteStacktrace: ''
}

x-pack/test_serverless/functional/test_suites/observability/infra/node_details.ts serverless observability UI - feature flags Observability Infra Node Details #With Asset Details Osquery Tab should not render in serverless

Error: expected true to equal false
    at Assertion.assert (expect.js:100:11)
    at Assertion.apply (expect.js:227:8)
    at Assertion.be (expect.js:69:22)
    at Context.<anonymous> (node_details.ts:52:35)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Object.apply (wrap_function.js:73:16)

x-pack/test_serverless/functional/test_suites/observability/infra/hosts_page.ts serverless observability UI - feature flags Observability Infra Hosts Page #Single Host Flyout Tabs "before all" hook in "Tabs"

Error: timed out waiting for endDate is set to Oct 17, 2018 @ 19:58:03.952 -- last error: Error: retry.try reached timeout 120000 ms
TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="superDatePickerendDatePopoverButton"])
Wait timed out after 10004ms
    at /opt/buildkite-agent/builds/bk-agent-prod-gcp-1725020341450222460/elastic/kibana-pull-request/kibana/node_modules/selenium-webdriver/lib/webdriver.js:913:22
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at onFailure (retry_for_success.ts:17:9)
    at retryForSuccess (retry_for_success.ts:84:7)
    at RetryService.try (retry.ts:51:12)
    at Proxy.clickByCssSelector (find.ts:419:5)
    at TestSubjects.click (test_subjects.ts:168:5)
    at time_picker.ts:155:7
    at runAttempt (retry_for_success.ts:29:15)
    at retryForSuccess (retry_for_success.ts:98:21)
    at retryForTruthy (retry_for_truthy.ts:27:3)
    at RetryService.waitFor (retry.ts:87:5)
    at TimePickerPageObject.setAbsoluteRange (time_picker.ts:154:5)
    at Context.<anonymous> (hosts_page.ts:66:11)
    at Object.apply (wrap_function.js:73:16)
    at onFailure (retry_for_truthy.ts:39:13)
    at retryForSuccess (retry_for_success.ts:84:7)
    at retryForTruthy (retry_for_truthy.ts:27:3)
    at RetryService.waitFor (retry.ts:87:5)
    at TimePickerPageObject.setAbsoluteRange (time_picker.ts:154:5)
    at Context.<anonymous> (hosts_page.ts:66:11)
    at Object.apply (wrap_function.js:73:16)

serverless observability UI - feature flags Observability Infra Hosts Page #Single Host Flyout Tabs "after all" hook in "Tabs"

Error: retry.try reached timeout 120000 ms
Error: retry.try reached timeout 120000 ms
TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="euiFlyoutCloseButton"])
Wait timed out after 10019ms
    at /opt/buildkite-agent/builds/bk-agent-prod-gcp-1725020341450222460/elastic/kibana-pull-request/kibana/node_modules/selenium-webdriver/lib/webdriver.js:913:22
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at onFailure (retry_for_success.ts:17:9)
    at retryForSuccess (retry_for_success.ts:84:7)
    at RetryService.try (retry.ts:51:12)
    at Proxy.clickByCssSelector (find.ts:419:5)
    at TestSubjects.click (test_subjects.ts:168:5)
    at hosts_page.ts:78:13
    at runAttempt (retry_for_success.ts:29:15)
    at retryForSuccess (retry_for_success.ts:98:21)
    at RetryService.try (retry.ts:51:12)
    at Context.<anonymous> (hosts_page.ts:77:11)
    at Object.apply (wrap_function.js:73:16)
    at onFailure (retry_for_success.ts:17:9)
    at retryForSuccess (retry_for_success.ts:84:7)
    at RetryService.try (retry.ts:51:12)
    at Context.<anonymous> (hosts_page.ts:77:11)
    at Object.apply (wrap_function.js:73:16)
elasticmachine commented 2 months ago

Pinging @elastic/obs-ux-logs-team (Team:obs-ux-logs)

elasticmachine commented 2 months ago

Pinging @elastic/obs-ux-infra_services-team (Team:obs-ux-infra_services)