search

elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
20.35k stars 8.33k forks source link

[FLAKY ON MKI] `x-pack/test/api_integration/deployment_agnostic/apis/observability/synthetics/create_monitor_private_location.ts` #210321

Open wayneseymour opened 1 month ago

wayneseymour commented 1 month ago

Summary

Test failed 4 times since Dec 14th of last year. I do see a change about 2 weeks ago

Test

Serverless Observability - Deployment-agnostic API integration tests SyntheticsAPITests PrivateLocationAddMonitor handles auto upgrading policies

Command Line

node scripts/functional_test_runner.js --config x-pack/test/api_integration/deployment_agnostic/configs/serverless/oblt.serverless.config.ts --exclude-tag skipMKI --exclude-tag failsOnMKI --exclude-tag skipServerless --exclude-tag skipSvlOblt --info

Error message

Error: expected '1.2.4' to sort of equal '1.1.1'
    at Assertion.assert (expect.js:100:11)
    at Assertion.eql (expect.js:244:8)
    at Context. (create_monitor_private_location.ts:513:47)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Object.apply (wrap_function.js:74:16) {
  actual: '1.2.4',
  expected: '1.1.1',
  showDiff: true
}
elasticmachine commented 1 month ago

Pinging @elastic/obs-ux-management-team (Team:obs-ux-management)

dominiqueclarke commented 3 weeks ago

@wayneseymour Do you know if this has failed any more recently? I'm not sure how to find out.

This test has changed since this was reported and I believe the changes should prevent this error in particular.

wayneseymour commented 3 weeks ago

Lately, what I do is just a find, within that channel...

This is what I entered to search

in:#kibana-serverless-test-alerts Serverless Observability - Deployment-agnostic API integration tests SyntheticsAPITests PrivateLocationAddMonitor handles auto

Result

Image

Earlier?

Looks like I added the skip PR on Feb 10th. So, then earlier would be the day before that