espressif / esp-matter

Espressif's SDK for Matter
Apache License 2.0
648 stars 153 forks source link

Fails the matter test case [TC-OO-2.3] (CON-431) #336

Closed maenkai closed 1 year ago

maenkai commented 1 year ago

esp-idf: v4.4.2 esp-matter: commit-id fde2c7ea84fee46d4dfa8a874d63a054229ceee6 Out of three tests, one succeeded and two failed The following tests cannot be passed using the Matter Test Harness(V2.6)


TC-O-2.3
12b: Reads OffWaitTime attribute from DUT
21b: Reads OffWaitTime attribute from DUT
maenkai commented 1 year ago

FAIL: 截图 2023-04-12 16-12-18

TH-V2.6 LOG UI_Test_Run_2023_4_19_17_36_28.txt

wqx6 commented 1 year ago

Can you please disable the log and test again? The log output might affect the attribute value.

maenkai commented 1 year ago

Can you please disable the log and test again? The log output might affect the attribute value.

I have modified the configuration item, but still failed CONFIG_LOG_DEFAULT_LEVEL_NONE=y

The success rate of this item is 8/10

stefano055415 commented 1 year ago

@maenkai @wqx6

I also have the same problem but I use esp-idf: v5.0.1 and esp-matter_ commit 1b95fcf66793c2ead7df933d8d80eefd7f8f6b95

did you find a solution?

Thank you

maenkai commented 1 year ago

@maenkai @wqx6

I also have the same problem but I use esp-idf: v5.0.1 and esp-matter_ commit 1b95fcf

did you find a solution?

Thank you

1.. Close the log using menuconfig

  1. Although the probability of failure is reduced, the problem still has a chance to recur
stefano055415 commented 1 year ago

@maenkai

I tried disabling logging, but out of ten tests only one passed without errors, error reduction is minimal

hope it gets fixed soon

Thank you

stefano055415 commented 1 year ago

@maenkai

I have noticed that the problem occurs systematically on tests 14c 20b 23c and 24c

always: reads OnWaitTime attribute from DUT

maybe it can help

maenkai commented 1 year ago

@wqx6 I am going to do the test certification, please help solve the problem

VaishaliAvhale commented 1 year ago

On-Off Cluster Test Plan.zip please update your PICS file and retest the test case.

dhrishi commented 1 year ago

@maenkai Can you please confirm if the above PICS helped you?

maenkai commented 1 year ago

@maenkai Can you please confirm if the above PICS helped you?

Still failing, what does the failure of the project have to do with it, maybe I can optimize from the application layer

VaishaliAvhale commented 1 year ago

I have tested the above test case using the same PICS file which I shared with you and It is passed The steps which are failing in your test case are not applicable. Check it in the attached Test Report! If you're facing a different issue please share its logs and Test Report also which TH version you are using? Please use the updated TH version (Version: v2.9-beta1) Test Report.pdf

maenkai commented 1 year ago

I have tested the above test case using the same PICS file which I shared with you and It is passed The steps which are failing in your test case are not applicable. Check it in the attached Test Report! If you're facing a different issue please share its logs and Test Report also which TH version you are using? Please use the updated TH version (Version: v2.9-beta1) Test Report.pdf

My version is 2.6, only 2.7 can be found on the official website, please tell me how to get the next version 2.9, thank you!

VaishaliAvhale commented 1 year ago

Can you share that official website link here? I can see the latest version(Version: v2.9-beta1) in the Matter TH drive link!