project-chip / matter-test-scripts

Test scripts related to Matter Certification
https://csa-iot.org/
Apache License 2.0
9 stars 3 forks source link

[Bug] yaml script not updated after upgrade from 1.3 SVE TH version to v2.10+spring2024 #263

Open ZainZhongUL opened 4 months ago

ZainZhongUL commented 4 months ago

Describe the bug

The TC-DGTHREAD-1.1 yaml script is not updated after upgrading from a 1.3 SVE TH version to v2.10+spring2024. The expected value for ClusterRevision in step2 is 2, but the script still expects a value of 1.

Steps to reproduce the behavior

cd certification-tool ./scripts/stop.sh cd .. sudo rm -rf certification-tool/ git clone https://github.com/project-chip/certification-tool.git cd certification-tool git fetch git checkout v2.10+spring2024 git submodule update --init --recursive ./scripts/ubuntu/auto-update.sh v2.10+spring2024 ./scripts/start.sh

Expected behavior

Verify that the TH frontend and SHA are displayed as expected. image image

Check the TC-DGTHREAD-1.1 yaml script and verify that the expected value for ClusterRevision in step2 is 1, however The expected behavior is that the TC-DGTHREAD-1.1 yaml script should be updated after upgrading to v2.10+spring2024, and the expected value for ClusterRevision in step2 should be 2. image

Log files

TC-DGTHREAD-1.1.yaml.script.txt

PICS file

No response

Screenshots

No response

Environment

Environment Operating system: Ubuntu Certification Tool version: v2.10+spring2024

Additional Information

No response

hiltonlima commented 4 months ago

############# Commit used on TH v2.10+spring2024 : ############# Branch: v1.3-branch Fix LevelControl Move when no motion requested (#32539) (#32993) 11f94c3831 C Freeman cecille@google.com 16 Apr 2024 at 10:00 SHA: 11f94c383171b709712106362e902f65253f4968

Step 2 from Test_TC_DGTHREAD_1_1.yaml file:

- label: "Step 2: TH reads the ClusterRevision from DUT"
  command: "readAttribute"
  attribute: "ClusterRevision"
  response:
      value: 1
      constraints:
          type: int16u

############# SHA mentioned in the CSA slack thread: ############# Branch: master Fix OnSoftwareFaultDetect chiplock assert occuring on appError() (#32713) 5bb5c9e23d Junior Martinez 67972863+jmartinez-silabs@users.noreply.github.com 26 Mar 2024 at 18:02 SHA: 5bb5c9e23d532cea40476fc0bd1d3008522792ba Slack Thread: https://csamembers.slack.com/archives/C03MA7WR7Q8/p1715914088114769

Step 2 from Test_TC_DGTHREAD_1_1.yaml file:

- label: "Step 2: TH reads the ClusterRevision from DUT"
  command: "readAttribute"
  attribute: "ClusterRevision"
  response:
      value: 2
      constraints:
          type: int16u

The master branch has a different version of the Test_TC_DGTHREAD_1_1.yaml file than the v1.3-branch branch version.