project-chip / certification-tool

A test harness and tooling designed to simplify development, testing, and certification for devices, guided by the Connectivity Standards Alliance.
https://csa-iot.org/
Apache License 2.0
36 stars 22 forks source link

[Bug] TC-CADMIN-1.3 failed due to TH2 timeout error #135

Open Saravana-kr22 opened 8 months ago

Saravana-kr22 commented 8 months ago

Describe the bug

image

Reference log: cadmin-1-3.log tc-cadmin-1-3dut.txt

Additional Information

Note: This issue has been raised by the https://github.com/project-chip/matter-test-scripts/issues/83#issuecomment-1867326598

antonio-amjr commented 8 months ago

Hi Saravana,

I'm facing the same errors that you encountered with your tests. Besides commissioning, nothing works from TH2. And the step 5 regarding the TH1 only fails because it needs an info from step 3c.

Talking with the team, we were only aware of manual tests for those with two controllers. I'll ask around for some info.

cecille commented 7 months ago

This test won't work the way it's written - "beta" for the manual steps is not the same as "beta" for the automated steps.

I'm not sure I understand the attached issue - the pake verifier and the discriminator are both being provided very directly. Why can this test not use the passcode that matches the pake verifieir in the test? It's hard coded.

gladystonfranca commented 6 months ago

This test won't work the way it's written - "beta" for the manual steps is not the same as "beta" for the automated steps.

I'm not sure I understand the attached issue - the pake verifier and the discriminator are both being provided very directly. Why can this test not use the passcode that matches the pake verifieir in the test? It's hard coded.

@cecille , do you mean this test, the way it is written, would only work if executed manually?

Saravana-kr22 commented 6 months ago

This testcase is still failing in the latest TH: Version: 2.10-beta3+spring2024 Sha: 1fd1429

image

raul-marquez-csa commented 5 months ago

As per a conversation with @raju-apple and @cecille, this TC will not go in for 1.3 and is suggested to be ported to Python, it'll remain on hold.

yf-fan-org commented 3 weeks ago

This test item still needs to be tested in 1.3 but still having the same problem as before, please help! @raul-marquez-csa