search

project-chip / certification-tool

A test harness and tooling designed to simplify development, testing, and certification for devices, guided by the Connectivity Standards Alliance.
https://csa-iot.org/
Apache License 2.0
42 stars 24 forks source link

[Feature] TH should complain if there was no PICS file supplied #446

Open cecille opened 1 month ago

cecille commented 1 month ago

Feature description

Right now, the TH appears to be faking a PICS file and sending it to the scripts, but if there's no PICS file, it supplies an empty PICS file, which basically mean "test nothing".

Since the test framework does RECEIVE a PICS file, we have no way to determine if the PICS are set as intended, or if this was something made up by the TH because someone forgot to load the file into the config, or loaded it incorrectly.

Use Cases

If the TH could just pass through the ACTUAL pics files to the test framework, we can ensure that the correct PICS file was supplied when tests go to check pics.

Test Cases

Run a test that relies on PICS, run test, test should complain that there was no PICS file.

Additional Information

No response

fabiowmm commented 1 month ago

@rquidute please try to reproduce this.