elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.64k stars 8.23k forks source link

Failing test: Rules Management - Rule Bulk Actions Integration Tests - ESS Env - Trial License.x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/rule_bulk_actions/trial_license_complete_tier/perform_bulk_action_ess·ts - Rules Management - Rule Bulk Action API @ess perform_bulk_action - ESS specific logic should disable rules and migrate actions #196462

Open kibanamachine opened 1 month ago

kibanamachine commented 1 month ago

A test failed on a tracked branch

TypeError: Cannot read properties of undefined (reading 'uuid')
    at Context.<anonymous> (perform_bulk_action_ess.ts:209:37)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Object.apply (wrap_function.js:74:16)

First failure: kibana-on-merge - main

### Todo
- [ ] https://github.com/elastic/kibana/pull/197660
- [x] Skip the leftover flaky test in 8.16 ([PR](https://github.com/elastic/kibana/pull/199200))
- [ ] Fix and unskip the above test in 8.16
elasticmachine commented 1 month ago

Pinging @elastic/security-detection-rule-management (Team:Detection Rule Management)

kibanamachine commented 1 month ago

New failure: kibana-on-merge - 8.x

kibanamachine commented 1 month ago

New failure: kibana-on-merge - main

kibanamachine commented 1 month ago

New failure: kibana-on-merge - 8.x

kibanamachine commented 1 month ago

New failure: kibana-on-merge - main

kibanamachine commented 1 month ago

New failure: kibana-on-merge - main

kibanamachine commented 1 month ago

New failure: kibana-on-merge - main

jbudz commented 4 weeks ago

/skip

kibanamachine commented 4 weeks ago

Skipped

main: 9bca8b744af8bf2b2b5e5ff74680c494ae7d1824 8.x: 5f86c957f270c67fa98d3f408f8f0841c9c2f1ab

kibanamachine commented 4 weeks ago

New failure: kibana-on-merge - 8.x

elasticmachine commented 3 weeks ago

Pinging @elastic/security-solution (Team: SecuritySolution)

elasticmachine commented 3 weeks ago

Pinging @elastic/security-detections-response (Team:Detections and Resp)

banderror commented 3 weeks ago

@maximpn @xcrzx 👋

I assigned you to this one and https://github.com/elastic/kibana/issues/196470. By the end of this week we need to figure out who can work on these. The goal is to understand if these test failures are indications of a bug - in which case we will have less than one week for fixing it for v8.16.0 according to the release schedule.

maximpn commented 2 weeks ago

@banderror I created https://github.com/elastic/kibana/pull/197660 to address flakiness reported in this ticket and in https://github.com/elastic/kibana/issues/196470. It seems we might have race condition when performing bulk operations on enabled rules picked up by the task manager at the same time. I left only two functional tests with enabled rules since these tests check rule disabling. After applying my changes don't see any flakiness.

kibanamachine commented 1 week ago

New failure: kibana-on-merge - 8.16

kibanamachine commented 1 week ago

New failure: kibana-on-merge - 8.16

kibanamachine commented 1 week ago

New failure: kibana-on-merge - 8.16