project-chip / certification-tool

A test harness and tooling designed to simplify development, testing, and certification for devices, guided by the Connectivity Standards Alliance.
https://csa-iot.org/
Apache License 2.0
38 stars 23 forks source link

[Bug] UI-python testcases with the --tests arguments are failed to show results #196

Closed Saravana-kr22 closed 1 week ago

Saravana-kr22 commented 7 months ago

Describe the bug

The Python testcases which uses the --tests arguments gets hanged in the UI and fails to populate the result but we could see the test case is being executed properly through the DUT log flow. The runner doest ends and shows the result even the whole test case gets completed.

For eg: TC-SM-1.1 testcase is started its execution. but even after completion of the execution still it is in execution state. i.e instead of updating the result the script is waiting for the results, this cause the UI to be in the execution state

Steps to reproduce the behavior

Step-1. Update the config and pics file of the respective project for testcase which needs to be executed accordingly. Step-2. Open the project and Run the testcase by selecting the testcase in the add test.

Expected behavior

UI should be updated with the result of the python testcase

Log files

DUt log: loading.txt

Screenshots

image

Environment

TH version : Version: 2.10-beta3+spring2024 Sha: 1fd1429

Additional Information

The list of testcase affected by this issue:

rquidute commented 7 months ago

This issue seems to be related to: https://github.com/project-chip/certification-tool/issues/163

rquidute commented 6 months ago

Hi @Saravana-kr22, there is an update in the release branch. Could you check if the changes works for you? Could you please follow the steps bellow in order to update the release branch and test again?

./scripts/stop.sh cd certification-tool git fetch git checkout v2.10-beta3+spring2024 git pull git submodule update --init --recursive ./scripts/start.sh

Saravana-kr22 commented 1 week ago

This issue is resolved in latest TH image.