cnti-testcatalog / testsuite

📞📱☎️📡🌐 Cloud Native Telecom Initiative (CNTI) Test Catalog is a tool to check for and provide feedback on the use of K8s + cloud native best practices in networking applications and platforms
https://wiki.lfnetworking.org/display/LN/Test+Catalog
Apache License 2.0
169 stars 70 forks source link

[BUG] pod_delete test outputs API text during `cert` run #1974

Closed agentpoyo closed 2 months ago

agentpoyo commented 2 months ago

Describe the bug There seems to be API output when running the cert option that should be suppressed information as it breaks the PASS/FAIL/SKIP output when running the testsuite

To Reproduce Run cert against your CNF, in this example it was the sample-coredns-cnf/ configuration sample.

Expected behavior There should be no template or config API output when running the certification as it breaks the formatting of the output for tests.

Screenshots

Reliability, Resilience, and Availability Tests
✔️  ✨PASSED: pod_network_latency chaos test passed 🗡️💀♻
✔️  ✨PASSED: pod_network_corruption chaos test passed 🗡️💀♻
✔️  PASSED: disk_fill chaos test passed 🗡️💀♻
Running for: {"app.kubernetes.io/instance" => "coredns", "app.kubernetes.io/name" => "coredns", "k8s-app" => "coredns"}
Spec Hash: 
template: apiVersion: litmuschaos.io/v1alpha1
kind: ChaosEngine
metadata:
  name: coredns-coredns-26
  namespace: cnfspace
spec:
  engineState: 'active'
  appinfo:
    appns: 'cnfspace'
    applabel: 'app.kubernetes.io/instance=coredns'
    appkind: 'deployment'
  chaosServiceAccount: pod-delete-sa
  jobCleanUpPolicy: 'delete'
  experiments:
    - name: pod-delete
      spec:
        components:
          env:
            # specify the fill percentage according to the disk pressure required
            - name: TOTAL_CHAOS_DURATION
              value: '30'

            - name: CHAOS_INTERVAL
              value: '10'

            - name: TARGET_PODS
              value: ''
            - name: FORCE
              value: 'false'
✔️  PASSED: pod_delete chaos test passed 🗡️💀♻
Screenshot 2024-04-15 at 12 50 18 PM
agentpoyo commented 2 months ago

Checking out branch issue-1974 shows the API text no longer appears when pod_delete is run:

pair@cnfdev4:~/workspace/drew/testsuite$ ./cnf-testsuite pod_delete
✔️  PASSED: pod_delete chaos test passed 🗡️💀♻

Once passing github actions, this will be merged into main

lixuna commented 2 months ago

@agentpoyo is this passing github actions? Can this be closed?

agentpoyo commented 2 months ago

Yes, this is fixed. Closing. Thanks.