search

project-chip / certification-tool

A test harness and tooling designed to simplify development, testing, and certification for devices, guided by the Connectivity Standards Alliance.
https://csa-iot.org/
Apache License 2.0
27 stars 13 forks source link

[Bug] Custom test suites have inconsistent names #229

Open ccruzagralopes opened 3 months ago

ccruzagralopes commented 3 months ago

Describe the bug

The test suites for custom test cases (both from Custom YAML Tests and Custom SDK Python Tests) have inconsistent names. They have a "-custom" suffix during the test execution, but that doesn't appear during the test case selection.

Steps to reproduce the behavior

  1. Create custom YAML and Python test cases
  2. Run TH
  3. Select the custom test cases
  4. Verify that the suites for the custom collections don't have a "-custom" suffix
  5. Run test cases
  6. Verify that the test execution view shows a "-custom" suffix in the name of the test suites for the custom test cases

Expected behavior

Expected the suite name to be the same in both views

Log files

N/A

PICS file

N/A

Screenshots

Screenshot 2024-03-14 at 13 32 02 Screenshot 2024-03-14 at 13 38 26 Screenshot 2024-03-14 at 14 09 53 Screenshot 2024-03-14 at 14 13 00

Environment

Additional Information

No response