search

project-chip / certification-tool

A test harness and tooling designed to simplify development, testing, and certification for devices, guided by the Connectivity Standards Alliance.
https://csa-iot.org/
Apache License 2.0
28 stars 15 forks source link

Python test gets hangs once after the successfull commissioning in UI #195

Open KishokG opened 5 months ago

KishokG commented 5 months ago

Describe the bug

When we ran the below mentioned Python test in TH image, the test gets stucked(It's just loading for a long time) once after the successful commissioning and even not able to abort it.

Steps to reproduce the behavior

  1. From the Test-Harness user interface loaded the PICS file to select the test cases.
  2. Selected the python test case in python section to executed.
  3. Click the Start button on Test-Harness user interface.

Expected behavior

TC should execute successfully without error.

Sample Log files

ACE_2-2_Python_2024_02_22_17_11_35.log ACE_2-1_Python_2024_02_22_17_00_10.log

PICS file

No response

Screenshots

ACE

Environment

Version: 2.10-beta3+spring2024 Sha: 1fd1429

Additional Information

We suspect this could be a issue these is a Final result: PASS ! in middle of the test log which is suspicious image

KishokG commented 5 months ago

@survensa FYI

rquidute commented 4 months ago

Hi @KishokG, there is an update in the release branch. Could you check if the changes works for you? Could you please follow the steps bellow in order to update the release branch and test again?

./scripts/stop.sh cd certification-tool git fetch git checkout v2.10-beta3+spring2024 git pull git submodule update --init --recursive ./scripts/start.sh

Ashwinigrl commented 3 months ago

Hi @rquidute, Tried with latest ImageVersion: 2.10+spring2024 Sha: 5f28838 still facing the same issues for below test cases

Screenshots: image

Sample Log file for TC-RVCCLEANM-2.2: TC-RVCCLEANM-2.2.txt

rquidute commented 3 months ago

Hi @Ashwinigrl could you please attach the PICS file used?

Ashwinigrl commented 3 months ago

PICS File used : RVC Clean Mode Cluster Test Plan.zip RVC Run Mode Cluster Test Plan (1).zip

rquidute commented 3 months ago

Hi @Ashwinigrl could you please provide the test_parameters configuration used in those tests?

Ashwinigrl commented 3 months ago

Test parameters configuration used in above test cases: TC-RVCCLEANM-2.1 "int-arg": "PIXIT_ENDPOINT:1 PIXIT.RVCCLEANM.MODE_CHANGE_OK:2 PIXIT.RVCCLEANM.MODE_CHANGE_FAIL:0", "endpoint":"1" TC-RVCCLEANM-2.2 "endpoint":"1" TC-RVCRUNM-2.1 "int-arg": "PIXIT_ENDPOINT:1 PIXIT.RVCRUNM.MODE_CHANGE_OK:2 PIXIT.RVCRUNM.MODE_CHANGE_FAIL:0", "endpoint":"1" TC-RVCRUNM-2.2 "int-arg": "PIXIT.RVCRUNM.MODE_A:1 PIXIT.RVCRUNM.MODE_B:2", "endpoint":"1"

rquidute commented 3 months ago

Hi @Ashwinigrl, could you please test using the final spring version (v2.10+spring2024) following the steps bellow?

1 - sudo rm -rf certification-tool 2 - git clone -b v2.10+spring2024 https://github.com/project-chip/certification-tool.git 3 - cd certification-tool 4 - git submodule update --init --recursive 5 - ./scripts/pi-setup/auto-install.sh 5.1 - At the end of the script, select option 1 to restart the RaspberryPi 6 - Wait about 10 minutes to launch the TH user interface on the user's system using the browser