search

Linaro / lite-lava-docker-compose

LITE Team LAVA docker dispatcher
MIT License
5 stars 10 forks source link

tfm-regression-qemu.job: Capture both unique test ID and description #135

Closed pfalcon closed 3 years ago

pfalcon commented 3 years ago

SQUAD cannot handle duplicate testcase names (while LAVA can), https://github.com/Linaro/squad/issues/925. An easy fix would be to switch to use TF-M's testcase IDs as LAVA testcase names, but those aren't human-readable, so seeing a testcase (among ~170 other) won't tell you much without digging into source code. So, we hold onto keeping human-readable description, and capture both, even though that makes the testcase longish, with a static word "description" repeated thru each. An example of a testcase name now:

tfm_sst_test_2009_description_get_interface_with_invalid_data_lengths_and_offsets

Thanks to Milosz Wasilewski for suggesting this approach.

Signed-off-by: Paul Sokolovsky paul.sokolovsky@linaro.org

pfalcon commented 3 years ago

Tested locally, eager to see fully correct results in SQUAD, merging.