search

Dasharo / open-source-firmware-validation

OSFV infrastructure with automated tests and scripts for managing test results
Apache License 2.0
6 stars 1 forks source link

keywords.robot: list tests revision in log and report #214

Closed krystian-hebel closed 4 months ago

krystian-hebel commented 4 months ago

This is done to keep track of which version of test was actually run, as well as whether local changes were made. It should make it possible to repeat the same tests in the future and hopefully get the same results.

Link to source code of test is also added to suite metadata, but this may be just an approximation in case of local modifications. In such case, reported revision will have '-dirty' appended to the digest.

krystian-hebel commented 4 months ago

This is how it looks like: image

macpijan commented 4 months ago

Thanks @krystian-hebel , very useful improvement

pietrushnic commented 4 months ago

@krystian-hebel Yes, this is very useful. It should primarily improve future analysis, and IIUC can prevent releasing based on test results, which are made on a modified version of the repository.