oktetlabs / test-environment

OKTET Labs Test Environment
Other
5 stars 10 forks source link

Log parameter descriptions for each test #55

Open ol-arteman opened 1 month ago

ol-arteman commented 1 month ago

Tester does log a set of parameters for a test alongside their values for a given iteration, but it may not be enough to understand what's going on, since parameter names are not always self-documenting. We do (at least should) have parameter descriptions in the test source as Doxygen comments. We do already generate tests-info.xml by parsing the test sources, so the task is:

It's all pretty straightforward but there is a slight challenge in dealing with env, since tests normally do not access env directly, but rather its components such as pco_iut, so there should be some heuristics to guess which test source parameters correspond to which package.xml parameters.

okt-kostik commented 3 weeks ago

@ol-arteman

Do you have any preliminary patches?