search

project-chip / certification-tool

A test harness and tooling designed to simplify development, testing, and certification for devices, guided by the Connectivity Standards Alliance.
https://csa-iot.org/
Apache License 2.0
40 stars 23 forks source link

[Bug] TH hangs after closing a prompt from a simulated test #55

Closed raju-apple closed 2 weeks ago

raju-apple commented 1 year ago

From chip-certification-tool created by ccruzagralopes: CHIP-Specifications/chip-certification-tool#983

Describe the bug

The test execution in TH is hanging when the user closes a prompt from a test step in a simulated test case.

Steps to reproduce the behavior

  1. Run a simulated test case in TH (e.g.: TC-LVL-2.3)
  2. Complete pairing as instructed during test suite setup
  3. Close a prompt from a test step

Expected behavior

I expected the test case to finish with an error, which is what happens for manual test cases and chip-tool test cases

Log files

No response

PICS file

PICS.zip

Screenshots

Screenshot 2023-09-26 at 17 58 10

Environment

TH Fall2023

Additional Information

No response

raju-apple commented 1 year ago

The team discussed this over slack and decided that handling it only in the TH side is not the best option. First the runner should add a method for aborting the test case and then TH can call this method when a prompt is cancelled. The runner issue created for this is:

fabiowmm commented 2 weeks ago

Deprioritized.