project-chip / certification-tool

A test harness and tooling designed to simplify development, testing, and certification for devices, guided by the Connectivity Standards Alliance.
https://csa-iot.org/
Apache License 2.0
41 stars 23 forks source link

[Feature] Test harness log naming requires extra updates to fit to certification format (and is error prone as a result) #382

Open andy31415 opened 2 months ago

andy31415 commented 2 months ago

Feature description

During test events, we were asked to upload files in a specific naming format (e.g. TC-<test>-<dut_id>_log), where as the log download follows a different naming convention.

We should find a way to auto-select proper naming and downloads. A proposal would be:

Use Cases

Less error prone uploads of test logs. I have seen several Wrong log upload reviews during the test event.

Test Cases

No response

Additional Information

No response

fabiowmm commented 2 months ago

@andy31415 right now the file naming pattern is "UI_TestRun.log". We can't name the files according to the TC name since a log file covers an entire run and may contain several different TCs.

CC @raju-apple