elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.47k stars 8.04k forks source link

[Deployment Management] Unskip functional tests on Cloud #125701

Open yuliacech opened 2 years ago

yuliacech commented 2 years ago

We need to inspect our team's apps and fix functional tests that are currently being skipped on Cloud.

  1. For every app, search for skipCloud tag in the corresponding functional tests. There are usually api integration, functional and a11y tests for every app.
  2. If the test needs to know whether it's running on Cloud use deployment service
    ...
    const deployment = getService('deployment');
    ...
    const isCloud = await deployment.isCloud();
  3. To run an unskipped test on Cloud, use the Cloud flaky test runner and click "Build with parameters"
    • ESTF_GITHUB_OWNER is your github username
    • ESTF_GITHUB_REPO is kibana
    • ESTF_GITHUB_BRANCH is the branch with the unskipped test
    • ESTF_KIBANA_VERSION is usually main
    • ESTF_CLOUD_VERSION is usually 8.2.0-SNAPSHOT
    • ESTF_FLAKY_TEST_SUITE is the test file, for example x-pack/test/api_integration/apis/management/snapshot_restore/repositories.ts

Deployment Management apps:

elasticmachine commented 2 years ago

Pinging @elastic/platform-deployment-management (Team:Deployment Management)