[Bug] TC-CADMIN-1.3 failed due to TH2 timeout error

project-chip / certification-tool

A test harness and tooling designed to simplify development, testing, and certification for devices, guided by the Connectivity Standards Alliance.

https://csa-iot.org/

Apache License 2.0

42 stars 24 forks source link

[Bug] TC-CADMIN-1.3 failed due to TH2 timeout error #135

Open Saravana-kr22 opened 11 months ago

Saravana-kr22 commented 11 months ago

Describe the bug

In TC-CADMIN-1.3 UI unable to access the TH2 even after the successful commissioning of the TH2

Reference log: cadmin-1-3.log tc-cadmin-1-3dut.txt

Additional Information

Note: This issue has been raised by the https://github.com/project-chip/matter-test-scripts/issues/83#issuecomment-1867326598

antonio-amjr commented 10 months ago

Hi Saravana,

I'm facing the same errors that you encountered with your tests. Besides commissioning, nothing works from TH2. And the step 5 regarding the TH1 only fails because it needs an info from step 3c.

Talking with the team, we were only aware of manual tests for those with two controllers. I'll ask around for some info.

cecille commented 10 months ago

This test won't work the way it's written - "beta" for the manual steps is not the same as "beta" for the automated steps.

I'm not sure I understand the attached issue - the pake verifier and the discriminator are both being provided very directly. Why can this test not use the passcode that matches the pake verifieir in the test? It's hard coded.

gladystonfranca commented 9 months ago

This test won't work the way it's written - "beta" for the manual steps is not the same as "beta" for the automated steps.

I'm not sure I understand the attached issue - the pake verifier and the discriminator are both being provided very directly. Why can this test not use the passcode that matches the pake verifieir in the test? It's hard coded.

@cecille , do you mean this test, the way it is written, would only work if executed manually?

Saravana-kr22 commented 9 months ago

This testcase is still failing in the latest TH: Version: 2.10-beta3+spring2024 Sha: 1fd1429

raul-marquez-csa commented 8 months ago

As per a conversation with @raju-apple and @cecille, this TC will not go in for 1.3 and is suggested to be ported to Python, it'll remain on hold.

yf-fan-org commented 3 months ago

This test item still needs to be tested in 1.3 but still having the same problem as before, please help! @raul-marquez-csa

KishokG commented 2 months ago

This testcase is still failing in the latest TH: Version: v2.11-beta3+fall2024 Sha: f52d40a

UI logs: UI_Test_Run_2024_09_11_17_05_44.log