project-chip / matter-test-scripts

Test scripts related to Matter Certification
https://csa-iot.org/
Apache License 2.0
9 stars 3 forks source link

TC-CNET-1.3 Matter 1.3 TE#2 incorrect verdict #142

Open SamCullen-Element opened 7 months ago

SamCullen-Element commented 7 months ago

Please follow the below template to file issues/concerns/feature enhancement against Test Scripts:

Summary Title:

Test script is giving an incorrect verdict, not assessing PICS declaration vs implementation correctly.

Description:

Attributes A0009 and A000A marked as FALSE in PICS declaration and PICS uploaded into tool. Attributes are true in the attribute list but the test harness has not flagged this resulting in an incorrect PASS verdict. Associated feature is not marked as True, potentially root for the attributes not being checked correctly.

Steps to reproduce:

Logs:

Not applicable, trace was uploaded in TE#2.

Additional Info:

cecille commented 7 months ago

this test assumes the pics values are correct as provided. The pics checker test will catch such errors.

cecille commented 5 months ago

IMO, this issue should now be closed - IDM 10.4 is for PICS validation, this test assumes the pics are correct, as do ALL of the other tests in the test suite.