E2E test suite for opendatahub.io operator using fabric8 kubernetes client
standard
- e2e tests that install the operator and needed operands and verify the use cases. Could be used as regression profile.
smoke
- quick verification for install ODH and some notebooksupgrade
- perform operator upgrade verification
olm-upgrade
- tests that perform upgrade with operator installed via OLMbundle-upgrade
- tests that perform upgrade with operator installed via yaml filescontinuous
- specific tests designed to verify this scenario. Do not use it unless you install the scenario from the link!all
(standard + upgrade)GITHUB_TOKEN="your_github_read_token" ./mvnw verify -Pcontinuous
GITHUB_TOKEN="your_github_read_token" ./mvnw verify -Pstandard
GITHUB_TOKEN="your_github_read_token" ./mvnw verify -Pstandard -Dit.test=DataScienceClusterST#createDataScienceCluster
GITHUB_TOKEN="your_github_read_token" ./mvnw verify -Pupgrade
GITHUB_TOKEN="your_github_read_token" ./mvnw test
When every test run is executed, test suite automatically creates a config.yaml
file
which contains all configured environment variables. Location of config file
is $LOG_DIR/test-run-YYYY-MM-DD_HH-mm/config.yaml
where $LOG_DIR
is by
default ${repo_root}/target/logs
.
GITHUB_TOKEN="your_github_read_token" ENV_FILE=path_to_file/config.yaml ./mvnw verify -Psmoke
During failures all logs relevant logs are collected and stored in target/logs
so users can go through the logs and see if the problem was in project or in tests.
As part of target/logs
you can find file config.yaml
that contains all env variables used by the test run.
You can easily re-use it by pass path to the file into ENV_FILE
environment variable.
Note that we suggest to copy the file outside the target dir.
We are using test-metadata-generator maven plugin for annotating tests and generate test documentation from it. The docs are generated with every build and the changes should be committed when there are some.
The plugin is still under development so the format could change. For more info see the plugin repository on GitHub.
Enable the -Pallure
Maven profile to collect testrun data for Allure reporting.
GITHUB_TOKEN="your_github_read_token" ./mvnw verify -Pstandard -Pallure
Then use the Allure Maven plugin to open a HTML report with the results in a web browser.
GITHUB_TOKEN="your_github_read_token" ./mvnw allure:serve
This test suite uses test-frame module.