search

cnti-testcatalog / testsuite

📞📱☎️📡🌐 Cloud Native Telecom Initiative (CNTI) Test Catalog is a tool to check for and provide feedback on the use of K8s + cloud native best practices in networking applications and platforms
https://wiki.lfnetworking.org/display/LN/Test+Catalog
Apache License 2.0
174 stars 72 forks source link

[BUG] CNF Cert test cases not working in offline mode. #2099

Closed adityaSiso closed 4 months ago

adityaSiso commented 4 months ago

Describe the bug CNF cert test cases are not working in offline mode.

To Reproduce

  1. Setup airgapped installation using official documentation (https://github.com/cncf/cnf-testsuite/blob/main/AIRGAP.md)
  2. Execute whole cert test suite via command: cnf-testsuite cer or a single cert test case via command : cnf-testsuite privilege_escalation or cnf-testsuite elastic_volumes.
  3. It generates the following error message: 
    E, [2024-07-03 09:31:13 +00:00 #480402] ERROR -- cnf-testsuite: Error opening file with mode 'r': '/home/ubuntu/cnfs/chart-1719937059/temp_template.yml': No such file or directory
E, [2024-07-03 09:31:13 +00:00 #480402] ERROR -- cnf-testsuite: /usr/share/crystal/src/crystal/system/unix/file.cr:11:7 in 'open'
E, [2024-07-03 09:31:13 +00:00 #480402] ERROR -- cnf-testsuite: /usr/share/crystal/src/file.cr:121:5 in 'read'
E, [2024-07-03 09:31:13 +00:00 #480402] ERROR -- cnf-testsuite: /workspace/lib/helm/helm.cr:76:19 in 'parse_manifest_as_ymls'
E, [2024-07-03 09:31:13 +00:00 #480402] ERROR -- cnf-testsuite: /workspace/src/tasks/utils/cnf_manager.cr:100:23 in 'cnf_resource_ymls'
E, [2024-07-03 09:31:13 +00:00 #480402] ERROR -- cnf-testsuite: /workspace/src/tasks/utils/cnf_manager.cr:149:21 in '->'
E, [2024-07-03 09:31:13 +00:00 #480402] ERROR -- cnf-testsuite: /workspace/src/tasks/utils/task.cr:118:11 in 'all_cnfs_task_runner'
E, [2024-07-03 09:31:13 +00:00 #480402] ERROR -- cnf-testsuite: /workspace/src/tasks/utils/task.cr:38:9 in 'task_runner:task'
E, [2024-07-03 09:31:13 +00:00 #480402] ERROR -- cnf-testsuite: /workspace/lib/sam/src/sam/execution.cr:32:7 in 'invoke_tasks_by_tag_list'
E, [2024-07-03 09:31:13 +00:00 #480402] ERROR -- cnf-testsuite: /usr/share/crystal/src/indexable.cr:697:3 in '->'
E, [2024-07-03 09:31:13 +00:00 #480402] ERROR -- cnf-testsuite: /workspace/lib/sam/src/sam/execution.cr:20:7 in 'call'
E, [2024-07-03 09:31:13 +00:00 #480402] ERROR -- cnf-testsuite: /workspace/lib/sam/src/sam/execution.cr:20:7 in '__crystal_main'
E, [2024-07-03 09:31:13 +00:00 #480402] ERROR -- cnf-testsuite: /usr/share/crystal/src/crystal/main.cr:115:5 in 'main'
E, [2024-07-03 09:31:13 +00:00 #480402] ERROR -- cnf-testsuite: src/env/__libc_start_main.c:95:2 in 'libc_start_main_stage2'

Expected behaviour The cert test cases should work properly.

Screenshots

image

Device (please complete the following information):

Additional context Getting the same behaviour on the example cnfs mentioned in the documentation.

martin-mat commented 4 months ago

I understand your expectation based on documentation of airgapped mode, however testing of that was removed and the feature will be probably removed as well.

1160

If you are interested in this feature and willing to support it, feel free to get in touch with CNTi testsuite community to discuss it.

martin-mat commented 4 months ago

Closing the issues as the airgapped/offline mode is being removed.