elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.48k stars 8.04k forks source link

Failing test: Chrome X-Pack UI Functional Tests - ML anomaly_detection_result_views.x-pack/test/functional/apps/ml/anomaly_detection_result_views/forecasts·ts - machine learning - anomaly detection forecasts with single metric job displays job results #164381

Open kibanamachine opened 10 months ago

kibanamachine commented 10 months ago

A test failed on a tracked branch

Error: expected testSubject(mlForecastValuesline) to exist
    at TestSubjects.existOrFail (test_subjects.ts:71:13)
    at Object.assertForecastChartElementsExists (forecast.ts:38:7)
    at Context.<anonymous> (forecasts.ts:101:9)
    at Object.apply (wrap_function.js:73:16)

First failure: CI Build - main

elasticmachine commented 10 months ago

Pinging @elastic/ml-ui (:ml)

kibanamachine commented 10 months ago

New failure: CI Build - main

kibanamachine commented 10 months ago

New failure: CI Build - main

kibanamachine commented 10 months ago

New failure: CI Build - main

mistic commented 10 months ago

Skipped.

main: 83a0eec

peteharverson commented 10 months ago

Removing the blocker label as the functionality is working correctly in manual tests. The functional test is failing because the time range slider is not moving after running the forecast to display the forecasted time range.

image

There must be some flakiness in the way the slider moves to show the forecast time range.

kibanamachine commented 3 weeks ago

New failure: kibana-on-merge - 8.14

kibanamachine commented 3 weeks ago

New failure: kibana-on-merge - 8.14

kibanamachine commented 3 weeks ago

New failure: kibana-on-merge - main

kibanamachine commented 3 weeks ago

New failure: kibana-on-merge - main

delanni commented 3 weeks ago

/skip

Skipping it because it started to fail over all 8.x branches, and PRs: 8.13, 8.14, main

kibanamachine commented 3 weeks ago

Skipped

8.14: 52a8b060d591210d99f785834ed61162438f47fb main: fdb387cfb761286f47e135fde2fda37bb885fa55

delanni commented 3 weeks ago

Also on several PRs, something probably changed in the dependencies:

kibanamachine commented 3 weeks ago

New failure: kibana-on-merge - 8.13

kibanamachine commented 3 weeks ago

New failure: kibana-on-merge - 8.13

alvarezmelissa87 commented 3 weeks ago

Checked on latest and 8.14.1 and looks like forecast is showing up correctly

image image

Looking at the failed test logs - looks like they are failing because the Show forecast checkbox is unchecked

image

Could be a timing issue in the test run as the unchecking of the forecast box happens right after the forecast chart line check. The chart line check does several retries. Might be worth breaking those two checks into separate it tests to avoid potential issues like this.

Removing blocker label as functionality is fine.

delanni commented 3 weeks ago

Similar breakage in 7.17: https://github.com/elastic/kibana/issues/186091