project-chip / certification-tool

A test harness and tooling designed to simplify development, testing, and certification for devices, guided by the Connectivity Standards Alliance.
https://csa-iot.org/
Apache License 2.0
36 stars 22 forks source link

[QUESTION] How to turn on PICS_EVENT_LIST_ENABLED flag? #150

Open Yinxq opened 7 months ago

Yinxq commented 7 months ago

Describe the bug

For TC-BINFO-1.1, I noticed that some steps are skipped, checking the yaml file shows that this is because PICS_EVENT_LIST_ENABLED = False. Are these steps needed to be tested? If they are needed, how should I turn on PICS_EVENT_LIST_ENABLED flag?

Steps to reproduce the behavior

No response

Expected behavior

No response

Log files

No response

PICS file

Basic Information Test Plan.txt

Screenshots

image image image

Environment

TH version: matter-th-fall2023 matter version: v1.2.0.1

Additional Information

No response

ccruzagralopes commented 7 months ago

Hey @raju-apple, this seems like a PICS Tool issue. Who should be assigned here?

raju-apple commented 7 months ago

Agustin , can you please respond on this ?

aperez-csa commented 7 months ago

Matter 1.2 Core Specificaiton Test Plan indicates that for TC-BINFO-1.1 step 5 is not supported.

image

The PICS_EVENT_LIST_ENABLED appears to be TH variable (not a PICS element)

Yinxq commented 7 months ago

Hi @aperez-csa, many thanks for your reply! These steps should be skipped.

I have another question. For TC-CNET-4.12, starting from step 8, in the verification section there is this sentence: Mark as not applicable and proceed to next step. Does this mean that these steps are not currently supported? image

cecille commented 7 months ago

Event lists are provisional. They should not be on in a certified product.

Minan-Tuyasmart commented 7 months ago

@cecille @aperez-csa I noticed that Event list is marked as M in the Matter-1.2-Core-Specification, but in the test plan it is marked as skippable, so which document should we use as the test standard when testing?

eventlist
cecille commented 6 months ago

Event list is not supported in 1.2. That it was not marked as P was a spec bug. @robszewczyk Do we have any way to mark spec errata for previous version?