cnti-testcatalog / testsuite

📞📱☎️📡🌐 Cloud Native Telecom Initiative (CNTI) Test Catalog is a tool to check for and provide feedback on the use of K8s + cloud native best practices in networking applications and platforms
https://wiki.lfnetworking.org/display/LN/Test+Catalog
Apache License 2.0
169 stars 70 forks source link

[Feature] Request to support multiple Helm Charts in CNTI Test Catalog #2090

Open collivier opened 3 days ago

collivier commented 3 days ago

Please contact guillermo.carretolopez@telefonica.com for any detail

Is your feature request related to a problem? Please describe.

In Sylva WG-02 (Validation Center), we want to execute CNTI Test catalog against every CNF that is going to be validated but all the CNFs that are already validated in Sylva have more than 2 Helm Charts (in some cases, up to 50 Helm Charts) so this is a problem because currently CNTI Test catalog only supports to test one Helm Chart at the same time.

Describe the solution you'd like

In order to save time and execute CNTI Test catalog in a more efficient way, we would like it to support the setup of multiple Helm Charts stored in a same filesystem folder to launch the tests battery directly over them at the same time and don’t have to execute it one by one manually.

Describe alternatives you've considered

we have been applying manually “cnf_setup” for each Helm Chart to be tested within a CNF and then launched “cnf testsuite cert” over the result. The problem is that for doing it we have to be changing manually “cnftestsuite.yaml” for each Helm Chart which drives to lose many time and we think that this could be supported in a more efficient manner.