search

project-chip / matter-test-scripts

Test scripts related to Matter Certification
https://csa-iot.org/
Apache License 2.0
9 stars 4 forks source link

[Bug] TC-CC-6.5 - TC failing due to Mismatch in ColorTemperatureMireds and ColorMode Attributes at Test Steps 4b and 5a #375

Open Rajashreekalmane opened 2 months ago

Rajashreekalmane commented 2 months ago

Describe the bug

The test case TC-CC-6.5 is failing due to mismatches in the ColorTemperatureMireds and ColorMode attributes. These mismatches are observed at Test Step 4b and Test Step 5a, respectively.

Steps to reproduce the behavior

From the Test-Harness user interface loaded the COLOR CONTROL and ONOFF .xml PICS file to select the test cases. Selected the TC-CC-6.5 Semi-Automated test case to executed. Executed the below mentioned command to put DUT into a commissionable state, ./chip-all-clusters-app Click the Start button on Test-Harness user interface.

Expected behavior

TC should execute successfully without error.

Log files

TC-CC-6.5.log

PICS file

On-Off Cluster Test Plan.zip Color Control Cluster Test Plan.zip

Screenshots

image

Environment

Version: v2.11-beta3+fall2024 Sha: f52d40a

Additional Information

No response

antonio-amjr commented 2 months ago

Hi @Rajashreekalmane,

I'm trying to understand better the expected behavior here.

On the step 2a, the test requires to change the StartUpColorTemperatureMireds value. As per logs, I saw that the device was configured to the value "32639". So later, after rebooting the device, I would expect that both StartUpColorTemperatureMireds (step 4a) and ColorTemperatureMireds (step 4b) should read the same value "32639" from the device. It's seems that the DUT is maintaining the default value of "250" even after configuring the StartUp value for something different?

Let me know your take on this.

Rajashreekalmane commented 2 months ago

In step 2a, the test requires changing the StartUpColorTemperatureMireds value. This value should be calculated based on the results of previous test steps as follows:

Otherwise, set StartUpColorTemperatureMireds = (ColorTempPhysicalMaxMireds - ColorTempPhysicalMinMireds)/2 + ColorTempPhysicalMinMireds.

Currently, we're seeing the following values:

StartUpColorTemperatureMireds: 250 ColorTempPhysicalMaxMireds: 454 ColorTempPhysicalMinMireds: 154 ColorTemperatureMireds: 250

Based on these, at step 2a, the correct value to send for StartUpColorTemperatureMireds is 304.

Please fine the attached log for manual validation TC-CC-6.5 VS.txt

antonio-amjr commented 2 months ago

Hi @Rajashreekalmane,

I see. It's probably an issue to discuss with the script team. I'll transfer the issue for their repository and assign @raul-marquez-csa for analyze this.