project-chip / certification-tool

A test harness and tooling designed to simplify development, testing, and certification for devices, guided by the Connectivity Standards Alliance.
https://csa-iot.org/
Apache License 2.0
41 stars 23 forks source link

[Feature] TH should separate test run logs #459

Open cecille opened 1 month ago

cecille commented 1 month ago

Feature description

These need to be uploaded by the ATLs. The grouped download option (where it's divided into passing, failing and skipped) is very helpful, but the ATLs still need to manually parse out the individual test cases for submission. If the TH could just tee these out to a file, it would really help the ATLs.

Use Cases

test case passes, download grouped results, ATL has a file that they can just directly send into TEDS or the cert website.

Test Cases

check with ATLs

Additional Information

No response

fabiowmm commented 4 weeks ago

@cecille don't quite understand what you are getting at here. What exactly you want as output from the TH? Grouping the TCs like in the grouped download option, but inside a single file?