Since its inception, the master check tool (Tests/scs-compliance-check.py) has been containing this comment:
# TODO: Add kubeconfig context as well
Now, the time has come to address this TODO. As far as I can tell, the test cases have become more complicated, and it might be necessary to pass multiple kubeconfigs (one for each major Kubernetes version to be inspected). Likewise, the IaaS tests for the domain manager role might need multiple OpenStack configs.
I think the master check tool should be agnostic as to these details. It should accept a set of environment variables and command-line parameters that it then passes on to the child processes. Alternatively, we could devise a yaml file that contains the configuration for the test subject in question (that is, for the "cloud" to be tested, which can comprise multiple OpenStack projects or multiple Kubernetes clusters). This yaml file could even allow to have a standard-specific "sections", so that test parameters can be given in a more fine-grained manner (with a global section as well, of course).
mbuechse
commented
8 months ago
Since its inception, the master check tool (
Tests/scs-compliance-check.py) has been containing this comment:Now, the time has come to address this TODO. As far as I can tell, the test cases have become more complicated, and it might be necessary to pass multiple kubeconfigs (one for each major Kubernetes version to be inspected). Likewise, the IaaS tests for the domain manager role might need multiple OpenStack configs.
I think the master check tool should be agnostic as to these details. It should accept a set of environment variables and command-line parameters that it then passes on to the child processes. Alternatively, we could devise a yaml file that contains the configuration for the test subject in question (that is, for the "cloud" to be tested, which can comprise multiple OpenStack projects or multiple Kubernetes clusters). This yaml file could even allow to have a standard-specific "sections", so that test parameters can be given in a more fine-grained manner (with a global section as well, of course).