exasol / integration-test-docker-environment

A docker-based environment for integration tests with the EXASOL DB.

https://exasol.github.io/integration-test-docker-environment/

MIT License

6 stars 2 forks source link

Run tests with dynamic matrix build in Github actions #114

Closed tkilias closed 2 years ago

tkilias commented 3 years ago

Background

The tests take considerable time if they run in sequence
Github Actions with dynamic matrix can reduce the runtime a lot
script-languages-container-tool already implements it
- https://github.com/exasol/script-languages-container-tool/blob/main/get_all_tests.sh
- https://github.com/exasol/script-languages-container-tool/blob/main/.github/workflows/main.yml

Acceptance Criteria

Generate dynamic matrix for all tests
Generate dynamic matrix for all Exasol versions

tomuben commented 2 years ago

Please note:

Job matrix - A job matrix can generate a maximum of 256 jobs per workflow run. This limit applies to both GitHub-hosted and self-hosted runners. Source: https://docs.github.com/en/actions/learn-github-actions/usage-limits-billing-and-administration

We already run the tests for different DB versions in parallel (32). We have currently 22 tests -> If we also split the tests in matrix build, we would 704 parallel jobs.

tkilias commented 2 years ago

Obsolete, because of the Github Limits