[Bug] Test Step Skipped for TC_OVENOPSTATE_2_5 - "Test Step Not Applicable" Repeatedly Skipped During Execution in UI

[Rajashreekalmane]

Describe the bug

While executing the Python test case TC_OVENOPSTATE_2_5 in UI, the test steps related to starting the Python test are repeatedly skipped with the message "Test Step Not Applicable: Start Python test".

Steps to reproduce the behavior

From the Test-Harness user interface loaded the Oven Cavity Operational State Cluster Test Plan.xml PICS file to select the test cases. Selected the TC_OVENOPSTATE_2_5 Python test case to executed. Executed the below mentioned command to put DUT into a commissionable state, ././chip-all-clusters-app Click the Start button on Test-Harness user interface.

Expected behavior

TC should execute successfully without error.

Log files

TC-OVENOPSTATE-2.5.log

PICS file

Oven Cavity Operational State Cluster Test Plan.zip

Screenshots

Environment

Version: v2.11-beta3+fall2024 Sha: f52d40a

Additional Information

No response

[rquidute]

Hi @Rajashreekalmane could you try running this test again? It seems this test was updated in v2.11-beta3.1+fall2024 version. You can update the branch using this command: ./scripts/ubuntu/auto-update.sh v2.11-beta3.1+fall2024

[Rajashreekalmane]

@rquidute As you suggested, I validated the test case in v2.11-beta3.1+fall2024 but received the same response as before UI_Test_Run_2024_10_03_13_04_12.log

Project configuration : { "config": { "test_parameters": { "int-arg": "PIXIT.WAITTIME.REBOOT:100", "timeout": 1000, "endpoint": "1" }, "network": { "wifi": { "ssid": "testharness", "password": "wifi-password" }, "thread": { "rcp_serial_path": "/dev/ttyACM0", "rcp_baudrate": 115200, "on_mesh_prefix": "fd11:22::/64", "network_interface": "eth0", "dataset": { "channel": "15", "panid": "0x1234", "extpanid": "1111111122222222", "networkkey": "00112233445566778899aabbccddeeff", "networkname": "DEMO" }, "otbr_docker_image": null } }, "dut_config": { "discriminator": "3840", "setup_code": "20202021", "pairing_mode": "onnetwork", "chip_timeout": null, "chip_use_paa_certs": false, "trace_log": true } }, "pics": { "clusters": { "Oven Cavity Operational State Cluster Test Plan": { "name": "Oven Cavity Operational State Cluster Test Plan", "items": { "OVENOPSTATE.S": { "number": "OVENOPSTATE.S", "enabled": true }, "OVENOPSTATE.C": { "number": "OVENOPSTATE.C", "enabled": true }, "OVENOPSTATE.S.A0000": { "number": "OVENOPSTATE.S.A0000", "enabled": true }, "OVENOPSTATE.S.A0001": { "number": "OVENOPSTATE.S.A0001", "enabled": true }, "OVENOPSTATE.S.A0002": { "number": "OVENOPSTATE.S.A0002", "enabled": true }, "OVENOPSTATE.S.A0003": { "number": "OVENOPSTATE.S.A0003", "enabled": true }, "OVENOPSTATE.S.A0004": { "number": "OVENOPSTATE.S.A0004", "enabled": true }, "OVENOPSTATE.S.A0005": { "number": "OVENOPSTATE.S.A0005", "enabled": true }, "OVENOPSTATE.S.E00": { "number": "OVENOPSTATE.S.E00", "enabled": true }, "OVENOPSTATE.S.E01": { "number": "OVENOPSTATE.S.E01", "enabled": true }, "OVENOPSTATE.S.C04.Tx": { "number": "OVENOPSTATE.S.C04.Tx", "enabled": true }, "OVENOPSTATE.S.C00.Rsp": { "number": "OVENOPSTATE.S.C00.Rsp", "enabled": true }, "OVENOPSTATE.S.C01.Rsp": { "number": "OVENOPSTATE.S.C01.Rsp", "enabled": true }, "OVENOPSTATE.S.C02.Rsp": { "number": "OVENOPSTATE.S.C02.Rsp", "enabled": true }, "OVENOPSTATE.S.C03.Rsp": { "number": "OVENOPSTATE.S.C03.Rsp", "enabled": true }, "OVENOPSTATE.S.M.ST_STOPPED": { "number": "OVENOPSTATE.S.M.ST_STOPPED", "enabled": true }, "OVENOPSTATE.S.M.ST_RUNNING": { "number": "OVENOPSTATE.S.M.ST_RUNNING", "enabled": true }, "OVENOPSTATE.S.M.ST_PAUSED": { "number": "OVENOPSTATE.S.M.ST_PAUSED", "enabled": true }, "OVENOPSTATE.S.M.ST_ERROR": { "number": "OVENOPSTATE.S.M.ST_ERROR", "enabled": true }, "OVENOPSTATE.S.M.ERR_NO_ERROR": { "number": "OVENOPSTATE.S.M.ERR_NO_ERROR", "enabled": true }, "OVENOPSTATE.S.M.ERR_UNABLE_TO_START_OR_RESUME": { "number": "OVENOPSTATE.S.M.ERR_UNABLE_TO_START_OR_RESUME", "enabled": true }, "OVENOPSTATE.S.M.ERR_UNABLE_TO_COMPLETE_OPERATION": { "number": "OVENOPSTATE.S.M.ERR_UNABLE_TO_COMPLETE_OPERATION", "enabled": true }, "OVENOPSTATE.S.M.ERR_COMMAND_INVALID_IN_STATE": { "number": "OVENOPSTATE.S.M.ERR_COMMAND_INVALID_IN_STATE", "enabled": true } } } } } }

Reference app used as DUT: ./chip-all-clusters-app

[fabiowmm]

@rquidute what's the status here?

[rquidute]

There already a PR with pending review: https://github.com/project-chip/certification-tool-backend/pull/154