elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.5k stars 8.06k forks source link

Failing test: Serverless Security API Integration Tests - Common Group 1.x-pack/test_serverless/api_integration/test_suites/common/index_management/inference_endpoints·ts - Index Management APIs Inference endpoints "before all" hook in "Inference endpoints" #185216

Closed kibanamachine closed 1 week ago

kibanamachine commented 1 month ago

A test failed on a tracked branch

Error: Expected status code 200, got 500 with body '{"error":{"root_cause":[{"type":"status_exception","reason":"Model importing failed due to an Exception [java.lang.IllegalArgumentException: [definition_length] must be greater than 0]"}],"type":"status_exception","reason":"Model importing failed due to an Exception [java.lang.IllegalArgumentException: [definition_length] must be greater than 0]","caused_by":{"type":"illegal_argument_exception","reason":"[definition_length] must be greater than 0"}},"status":500}'
    at Assertion.assert (expect.js:100:11)
    at Assertion.eql (expect.js:244:8)
    at Object.assertResponseStatusCode (api.ts:92:31)
    at Object.createInferenceEndpoint (api.ts:253:12)
    at processTicksAndRejections (node:internal/process/task_queues:95:5)
    at Context.<anonymous> (inference_endpoints.ts:27:9)
    at Object.apply (wrap_function.js:73:16) {
  actual: '500',
  expected: '200',
  showDiff: true
}

First failure: kibana-on-merge - main

elasticmachine commented 1 month ago

Pinging @elastic/kibana-management (Team:Kibana Management)

kibanamachine commented 1 month ago

New failure: kibana-on-merge - main

mistic commented 1 month ago

Skipped.

main: 404e8c9

saarikabhasi commented 1 month ago

This test is specific for Serverless version only. There is another test for ESS. Since Serverless release doesn't fall within a release version, removing the 8.15 tag.

This issue will be fixed before the feature is enabled for Serverless.

saarikabhasi commented 1 week ago

Closing this ticket with PR - https://github.com/elastic/kibana/pull/187521

In the PR:

  1. Modified test cases to use kibana internal path instead of directly calling es endpoint
  2. clean up underlying trained model
  3. un skipped the tests for now to confirm if this helps fixing flaky tests