We have a support matrix for Elastic products that we support, however our nightlies only run on a subset of these OS'es. We need to improve our nightlies to run for all OS'es from the matrix lists.
Proposed Solution
We already run tests for aarch64 - this means we have a way to override what image our tests are running on. We can run all connector functional tests for every supported image this way.
Alternatives
Always do testing manually in the end of the release - update manual test plan and execute it.
@markjhoy @tutelaris this kind of thing might be an area where the dev-prod team could help. I expect we're not the only ones who would like to automate running tests on a suite of OS's.
Problem Description
We have a support matrix for Elastic products that we support, however our nightlies only run on a subset of these OS'es. We need to improve our nightlies to run for all OS'es from the matrix lists.
Proposed Solution
We already run tests for aarch64 - this means we have a way to override what image our tests are running on. We can run all connector functional tests for every supported image this way.
Alternatives
Always do testing manually in the end of the release - update manual test plan and execute it.