project-chip / certification-tool

A test harness and tooling designed to simplify development, testing, and certification for devices, guided by the Connectivity Standards Alliance.
https://csa-iot.org/
Apache License 2.0
42 stars 24 forks source link

[Bug] IDM-10.4 fails on PICS_SDK_CI_ONLY #379

Closed adamb-q closed 3 months ago

adamb-q commented 3 months ago

Describe the bug

The test is failing always image the PICS_SDK_CI_ONLY is set https://github.com/project-chip/connectedhomeip/blame/master/src/python_testing/test_testing/test_IDM_10_4.py#L116

Steps to reproduce the behavior

No response

Expected behavior

No response

Log files

No response

PICS file

No response

Screenshots

No response

Environment

No response

Additional Information

No response

rquidute commented 3 months ago

Hi @adamb-q could you please share your project config and execution logs?

adamb-q commented 3 months ago

Logs: [TC-IDM-10.4]_[xfJLZJrv]_TH_log.log Config: config.json

rquidute commented 3 months ago

Hi @adamb-q, according to the logs, there are several PICS that was informed, was it is not on device. You can see in the log file from line 7013 Ex: problem: PICS I.S found in PICS list, but not on device

adamb-q commented 3 months ago

OK - I think I should check each endpoint separately, for now I just loaded all the PICS - the UI error message was misleading. I think it can be closed