project-chip / matter-test-scripts

Test scripts related to Matter Certification
https://csa-iot.org/
Apache License 2.0
9 stars 3 forks source link

python testing: update python scripts using TestStep to include expectation text #240

Open cecille opened 5 months ago

cecille commented 5 months ago

The TestStep dataclass was recently updated to include an expectation string, which is meant to match the expected outcome from the test plan. The current set of test that use the TestStep tend to paraphrase the test plan, but if we can move to this new style, then we can generate the test plans directly from the scripts and it's much easier to keep them in sync.

For each test

Note that some tests will require PICS removal before they can be updated.

Tests with no pics that can be updated now:

Tests that need a PICS re-work before the test plan can be generated