google / openhtf

The open-source hardware testing framework.
Apache License 2.0
530 stars 217 forks source link

Multiple tests or one test and multiple subtests? #1145

Open siwica opened 6 months ago

siwica commented 6 months ago

I am getting started with learning openhtf and I am wondering on how to best organize my tests.

My goal is to design a factory test, testing multiple fairly distinct features of the DUT: Ethernet connectivity, digital IOs, analog IOs, LEDs, ... What are best practices (advantages/disadvantages) on how to structure these tests?

Variant 1: One big Test. Subtests with multiple phases each for Ethernet, Digital I/O, Analog IO, ... I guess the advantage is that I can easily share state among the tests and the final evaluation ist easier?!

Variant 2 Distinct Tests for each component. I assume assembling a final evaluation is a bit harder in this case?

Is there some good open source project utilizing openhtf to write tests that I can read for best-practices on how to do things? Unfortunately documentation seems to be rather sparse...