search

cnti-testcatalog / testsuite

📞📱☎️📡🌐 Cloud Native Telecom Initiative (CNTI) Test Catalog is a tool to check for and provide feedback on the use of K8s + cloud native best practices in networking applications and platforms
https://wiki.lfnetworking.org/display/LN/Test+Catalog
Apache License 2.0
169 stars 70 forks source link

[BUG] pod_dns_error is always SKIPPED when "containerd" runtime is used #1977

Closed martin-mat closed 2 months ago

martin-mat commented 2 months ago

Describe the bug The test is always SKIPPED in case "containerd" container runtime is used.

"containerd" is a precondition for the k8s platform for cnf-testsuite.

To Reproduce Steps to reproduce the behavior:

  1. configure platform accordingly to https://github.com/cnti-testcatalog/testsuite/blob/main/INSTALL.md#pre-requisites
  2. execute pod_dns_error test
  3. the test result is "SKIPPED: pod_dns_error docker runtime not found"

Expected behavior test passes or fails depending on test result, even when using containerd runtime

martin-mat commented 2 months ago

Consider removing pod_dns_error from the certification criterions until this it fixed. It is meaningless to have it there currently.

taylor commented 2 months ago

TODO:

  1. Open a ticket in the certification repo to remove this as a test for certification
  2. Remove pod_dns_error from the cert command in the test suite (grouping of tests for the certification)
  3. Fix this test
    • Check upstream Litmus test to see if it supports containerd
    • Update testsuite test

Reference: Added to Certification list based on https://docs.google.com/document/d/1ysgGfiG2qEXJUyxksVnuzSeKTcp9V5-SId65_nwDRDg/edit