project-chip / certification-tool

A test harness and tooling designed to simplify development, testing, and certification for devices, guided by the Connectivity Standards Alliance.
https://csa-iot.org/
Apache License 2.0
42 stars 24 forks source link

[Bug] [Matter 1.4 SVE] [v2.11beta3.1+fall2024] [TC-IDM-10.5] PIXIT.IDM.ALLOW_EXTRA_CLUSTERS_ON_ENDPOINT:true is not passed to the script #435

Closed SirRu24 closed 1 month ago

SirRu24 commented 1 month ago

Describe the bug

All clusters app tested with the argument PIXIT.IDM.ALLOW_EXTRA_CLUSTERS_ON_ENDPOINT:true returned FAILED

Steps to reproduce the behavior

Test parameter: "test_parameters": { "timeout": "100000000", "bool-arg": "allow_provisional:true PIXIT.IDM.ALLOW_EXTRA_CLUSTERS_ON_ENDPOINT:true" }

Run the UI Python of TC-IDM-10.5

Expected behavior

It should have return PASS because all clusters app run multiple device clusters and it can only have one device type.

Log files

TC-IDM-10-5_2024_09_27_08_25_20.log

PICS file

No response

Screenshots

No response

Environment

TH version: v2.11beta3.1+fall2024

Additional Information

No response

hiltonlima commented 1 month ago

Looking at the log we can see that the parameter is passed by the command: --bool-arg allow_provisional:true PIXIT.IDM.ALLOW_EXTRA_CLUSTERS_ON_ENDPOINT:true

Command:

python3 /root/python_testing/scripts/sdk/test_harness_client.py sdk/TC_DeviceConformance TC_DeviceConformance --tests test_TC_IDM_10_5 --trace-to json:log --discriminator 3901 --passcode 20202021 --timeout 100000000 --bool-arg allow_provisional:true PIXIT.IDM.ALLOW_EXTRA_CLUSTERS_ON_ENDPOINT:true --PICS /var/tmp/pics
fabiowmm commented 1 month ago

Originator seems to have lost interest. Please reopen if still facing the issue.