project-chip / certification-tool

A test harness and tooling designed to simplify development, testing, and certification for devices, guided by the Connectivity Standards Alliance.
https://csa-iot.org/
Apache License 2.0
38 stars 22 forks source link

[Bug] Test Step Skipped for TC_OVENOPSTATE_2_5 - "Test Step Not Applicable" Repeatedly Skipped During Execution in UI #415

Open Rajashreekalmane opened 2 weeks ago

Rajashreekalmane commented 2 weeks ago

Describe the bug

While executing the Python test case TC_OVENOPSTATE_2_5 in UI, the test steps related to starting the Python test are repeatedly skipped with the message "Test Step Not Applicable: Start Python test".

Steps to reproduce the behavior

From the Test-Harness user interface loaded the Oven Cavity Operational State Cluster Test Plan.xml PICS file to select the test cases. Selected the TC_OVENOPSTATE_2_5 Python test case to executed. Executed the below mentioned command to put DUT into a commissionable state, ././chip-all-clusters-app Click the Start button on Test-Harness user interface.

Expected behavior

TC should execute successfully without error.

Log files

TC-OVENOPSTATE-2.5.log

PICS file

Oven Cavity Operational State Cluster Test Plan.zip

Screenshots

image

Environment

Version: v2.11-beta3+fall2024 Sha: f52d40a

Additional Information

No response

rquidute commented 15 hours ago

Hi @Rajashreekalmane could you try running this test again? It seems this test was updated in v2.11-beta3.1+fall2024 version. You can update the branch using this command: ./scripts/ubuntu/auto-update.sh v2.11-beta3.1+fall2024