search

DynamoRIO / dynamorio

Dynamic Instrumentation Tool Platform
Other
2.66k stars 562 forks source link

ARM suite test regressions: api.disA32, api.disT32, many more #3699

Open derekbruening opened 5 years ago

derekbruening commented 5 years ago

We did not have ARM tests being run for a while. Now that we have a CDash machine back up, I compared its debug run yesterday to the most recent on that same machine name from April 2018:

http://dynamorio.org/CDash/viewTest.php?buildid=35255

Testing started on 2018-04-18 23:37:13
Name    Status  Time    Details Labels
code_api|client.drmgr-test  Failed  5s 810ms    Completed (Failed)  
code_api|linux.signal_race  Failed  1m 30s 690ms    Completed (Failed)  
code_api|linux.eintr-noinline   Failed  1m 30s 220ms    Completed (Failed)  
code_api|tool.drcachesim.invariants Failed  1m 30s 410ms    Completed (Failed)  
code_api|tool.histogram.offline Failed  1m 31s 760ms    Completed (Failed)  
code_api|tool.drcachesim.delay-simple   Failed  8s 340ms    Completed (Failed)

http://dynamorio.org/CDash/viewTest.php?buildid=44194

Testing started on 2019-06-21 23:30:26
Name    Status  Time    Details Labels
code_api|linux.signal_race  Failed  1m 30s 20ms Completed (Failed)  
code_api|linux.eintr-noinline   Failed  1m 30s 180ms    Completed (Failed)  
 code_api|linux.sigsuspend Failed  1m 30s 100ms    Completed (Failed)  
 code_api|tool.drcacheoff.simple   Failed  6s 770ms    Completed (Failed)  
 code_api|tool.drcacheoff.filter   Failed  8s 820ms    Completed (Failed)  
 code_api|tool.drcacheoff.opcode_mix   Failed  7s 620ms    Completed (Failed)  
 code_api|linux.syscall_pwait  Failed  10s 890ms   Completed (Failed)  
 code_api|client.predicate-test    Failed  1s 110ms    Completed (Failed)  
 code_api|client.drreg-test    Failed  1s 520ms    Completed (Failed)  
code_api|client.drmgr-test  Failed  3s 410ms    Completed (Failed)  
 code_api|client.drutil-test   Failed  2s 420ms    Completed (Failed)  
 code_api|sample.opcodes   Failed  510ms   Completed (Failed)  
code_api|tool.drcachesim.delay-simple   Failed  4s 110ms    Completed (Failed)  
 code_api|tool.drcacheoff.multiproc    Failed  12s 390ms   Completed (Failed)  
 code_api|api.disA32   Failed  1s 360ms    Completed (Failed)  
 code_api|api.disT32   Failed  1s 430ms    Completed (Failed)
AssadHashmi commented 5 years ago

I'm assuming these regressions have happened because we don't have AArch32 precommit testing in the same way we have for AArch64?

Carrotman42 commented 5 years ago

Note: in a recent debug run code_api|linux.signal_race did not fail, so it is at least flaky.

In a recent release run we observe code_api|linux.reset failing as well. In addition, code_api|linux.sigsuspend and code_api|linux.signal_race passed in that run.

derekbruening commented 5 years ago

I'm assuming these regressions have happened because we don't have AArch32 precommit testing in the same way we have for AArch64?

That's my assumption, but I wouldn't have expected the ARM encoder/decoder tests to have broken. Hopefully it's something simple.