elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.5k stars 8.05k forks source link

Failing test: Dataset quality API Integration tests (basic).x-pack/test/dataset_quality_api_integration/tests/integrations/integrations·spec·ts - Dataset quality API tests integrations/integrations.spec.ts basic Integration gets the custom installed integrations returns custom integrations and its datasets map #187461

Closed kibanamachine closed 1 week ago

kibanamachine commented 2 weeks ago

A test failed on a tracked branch

Error: expected [] to sort of equal [ 'my.custom.integration' ]
    at Assertion.assert (expect.js:100:11)
    at Assertion.eql (expect.js:244:8)
    at Context.<anonymous> (integrations.spec.ts:109:82)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Object.apply (wrap_function.js:73:16) {
  actual: '[]',
  expected: '[\n  "my.custom.integration"\n]',
  showDiff: true
}

First failure: kibana-on-merge - main

elasticmachine commented 2 weeks ago

Pinging @elastic/obs-ux-logs-team (Team:obs-ux-logs)

achyutjhunjhunwala commented 1 week ago

This test failed once on the merge pipeline and then it did not fail. At the moment it also does not fails locally. I tried running the whole dataset quality integration test suite 10 times locally and could not reproduce this.

Given its an API test, it being flaky has a lesser chance though not 0. I will close this for the time being and investigate if this happens again