linux-system-roles / test-harness

Test harness for linux system roles
GNU General Public License v3.0
10 stars 18 forks source link

support ansible 2.12; support skip tags; support env. vars. in config #157

Closed richm closed 3 years ago

richm commented 3 years ago

Add support for ansible 2.12 using the ansible 2.12 container image from quay.io. Will need to update once they move it to stable.

Allow image config to specify env. vars. for each image. This should fix some problems we have seen on el6 and el7.

Allow to specify Ansible skip tags. For example, qemu CI can skip the cleanup section. The new 2.12 runner needs to skip nvme since it isn't supported on the container image platform.

Always grab the standard-inventory-qcow2 script from pagure since the package is released very infrequently and we need all of the newly merged functionality.

Add support for github paging when retrieving a list of items from github.

Add reporting of the github rate limit information.

Add support for being able to test a role without a PR by using PR number 0. Add support for being able to test all roles by specifying TEST_HARNESS_PULL_REQUEST=ALL. In these cases, there will be no status reporting in a PR since there isn't one. You'll need to go to the logs repo and find them.

Fix support for requirements.yml - was not working in all cases with the new ansible 2.12 environment.

Add support for TEST_HARNESS_DEBUG for easily enabling debug logging for a particular deployment.

Download and install role2collection at container buildtime.

nhosoi commented 3 years ago

@richm, lgtm on the most part. May I ask where this feature is implemented?

Allow to specify Ansible skip tags. For example, qemu CI can skip the cleanup section. The new 2.12 runner needs to skip nvme since it isn't supported on the container image platform.

richm commented 3 years ago

@richm, lgtm on the most part. May I ask where this feature is implemented?

Allow to specify Ansible skip tags. For example, qemu CI can skip the cleanup section. The new 2.12 runner needs to skip nvme since it isn't supported on the container image platform.

The tags are passed to ansible-playbook here - https://github.com/linux-system-roles/test-harness/pull/157/files#diff-9846b1cbe8ec156c644dff043f5b39dc5b6db89129e48d035b78b88bb41c4353R671

args.skip_tags is set here - https://github.com/linux-system-roles/test-harness/pull/157/files#diff-9846b1cbe8ec156c644dff043f5b39dc5b6db89129e48d035b78b88bb41c4353R1362

The TEST_HARNESS_SKIP_TAGS env. var. is set in the inventory and passed in to the deployment via test_harness_deploy_env_a212 https://github.com/linux-system-roles/test-harness/pull/157/files#diff-7b28b8c4e18bcb0a88a3f5dd9017f17079c09851b6e931a8c688a1cc9b523b77R168