Integration of basic functional test suite developed with FTR into the Create Environment workflow

gurevichdmitry commented 4 months ago

Summary of your changes

This PR adds the ability to run test suites written in the Kibana repository using the Functional Test Runner (FTR). The integration is achieved through the Create Environment workflow. When the UI sanity check option is selected, the Create Environment workflow will execute UI sanity checks from the Kibana repository. The main branch of Kibana will be used for checkout.

Running Kibana tests using FTR was implemented as a separate GitHub action kibana-ftr, which is reused in the Create Environment workflow. This action checks out the specified Kibana branch without history, then installs necessary tools and performs a bootstrap. After preparation, FTR is executed with the specified configuration.

Screenshot/Data

This PR introduces two input parameters for the Create Environment workflow: run-ui-sanity-tests flag, which allows you to select whether to run UI sanity tests, and ref_commit_sha, which allows you to choose the appropriate Kibana branch, tag, or commit SHA.

Screenshot 2024-05-22 at 14 42 05

New Step in the workflow Screenshot 2024-05-22 at 14 44 25

Report Example Screenshot 2024-05-22 at 14 45 27

Related Issues

Checklist

[ ] I have added tests that prove my fix is effective or that my feature works
[x] I have added the necessary README/documentation (if appropriate)

Introducing a new rule?

[ ] Generate rule metadata using this script
[ ] Add relevant unit tests
[ ] Generate relevant rule templates using this script, and open a PR in elastic/packages/cloud_security_posture

mergify[bot] commented 4 months ago

This pull request does not have a backport label. Could you fix it @gurevichdmitry? 🙏 To fixup this pull request, you need to add the backport labels for the needed branches, such as:

backport-v./d./d./d is the label to automatically backport to the 8./d branch. /d is the digit NOTE: backport-skip has been added to this pull request.

github-actions[bot] commented 4 months ago

:bar_chart: Allure Report - :green_heart: No failures were reported.

Result	Count
🟥 Failed	0
🟩 Passed	359
⬜ Skipped	33

gurevichdmitry commented 4 months ago

This is the latest run after addressing review comments.

elastic / cloudbeat