cnti-testcatalog / testsuite

📞📱☎️📡🌐 Cloud Native Telecom Initiative (CNTI) Test Catalog is a tool to check for and provide feedback on the use of K8s + cloud native best practices in networking applications and platforms
https://wiki.lfnetworking.org/display/LN/Test+Catalog
Apache License 2.0
173 stars 71 forks source link

Enhancement: Add test name before and after the test in console output #1962

Closed kosstennbl closed 5 months ago

kosstennbl commented 5 months ago

Add information of which test is starting to the console output Add test name to test result console output

Issues:

Refs: #1958

No documentation update is needed. Only outputs have been modified, functionality shouldn't be affected in any way.

kosstennbl commented 5 months ago

True, i forgot about that. Would it be fine to replace expected regex messages like "PASSED: Resources output logs to stdout and stderr" with just "PASSED"?

kosstennbl commented 5 months ago

Waits for merge of #1954 Then messages should be redesigned with [[^\n]*] inside regex

agentpoyo commented 5 months ago

Please create WIP or DRAFT PRs as DRAFT's when creating, this will prevent any accidental merges as "Draft" status will grey out the "merge" button until they're actually ready for review and merging.

HashNuke commented 5 months ago

I've changed the status of this PR to draft to reflect the title.

kosstennbl commented 5 months ago

Ready to test, not a draft anymore. @HashNuke

Btw, i can't change status from draft to open (probably insufficient permissions)

HashNuke commented 5 months ago

@kosstennbl I held back on this PR because the main branch builds were broken.

I've made some fixes to the kubescape issues in the kubescape-version-check branch. The build is green. So the changes should be merged into main branch anytime soon. It might introduce some conflicts because some automated tests and specs were updated.

kosstennbl commented 5 months ago

@HashNuke Ok, sure, I'll try to resolve conflicts as soon as possible

HashNuke commented 5 months ago

@kosstennbl Quick update - #2004 has been merged into main. This PR is now showing 2 conflicts.

kosstennbl commented 5 months ago

@HashNuke Rebase done, please run tests.

HashNuke commented 5 months ago

@kosstennbl There are two failing tags in the build - https://github.com/cnti-testcatalog/testsuite/actions/runs/8860425833/job/24331957328

HashNuke commented 5 months ago

For anyone else curious what the output now looks like with this PR, I just ran the workload test for a sample CNF. Screenshot below. LGTM.

CleanShot 2024-04-27 at 21 20 13@2x

kosstennbl commented 5 months ago

@HashNuke Fixed task_runner (checked localy - it passed), deleted exposed_dashboard. Please retest

HashNuke commented 5 months ago

Build passing - https://github.com/cnti-testcatalog/testsuite/actions/runs/8861261394

Will wait for the main branch build to pass before merging this PR.