ARM-software / trappy

This repository has moved to https://gitlab.arm.com/tooling/trappy
Apache License 2.0
60 stars 39 forks source link

Explore possibility of time-based tests for trappy #257

Open joelagnel opened 7 years ago

joelagnel commented 7 years ago

Recently lot of speed up related patches have posted. It would be good to be able to test and make sure these improvements aren't regressed in the future. One concern is that its hardware dependent and is hard to measure. This issue is created to discuss this. I think we can still come up with a worst-case upper bound experimentally and set that as the expectation. If we are threading trappy in the future, then we can perhaps limit the number of threads so that the number of cores that the test is run on doesn't change or artificially make a failure result as passed (as a false-positive). (CC @derkling)