DynamoRIO / dynamorio

Dynamic Instrumentation Tool Platform
Other
2.61k stars 554 forks source link

cbr4 test failed on VS2017 32-bit GA CI with y=1 instead of y=5 #4792

Open derekbruening opened 3 years ago

derekbruening commented 3 years ago

The test wants y=5 but it printed y=1 for the 32-bit Windows test:

130/283 Test #129: code_api|client.cbr4 .........................................***Failed  Required regular expression not found. Regex=[^cbr taken
?
cbr not taken
?
cbr taken
?
cbr taken
?
cbr not taken
?
y=5
?
$
]  1.33 sec
cbr taken
cbr not taken
cbr taken
cbr taken
cbr not taken
y=1
derekbruening commented 3 years ago

https://github.com/DynamoRIO/dynamorio/runs/2149306508?check_suite_focus=true

derekbruening commented 3 years ago

Happened again, on 32-bit, on a master merge: https://github.com/DynamoRIO/dynamorio/runs/2162692800?check_suite_focus=true

derekbruening commented 3 years ago

This test keeps failing on the master merge: https://github.com/DynamoRIO/dynamorio/runs/2177174202?check_suite_focus=true

Yet it passes on the PR: https://github.com/DynamoRIO/dynamorio/runs/2176970377?check_suite_focus=true

121: cbr taken
121: cbr not taken
121: cbr taken
121: cbr taken
121: cbr not taken
121: y=5
122/236 Test #121: code_api|client.cbr4 .........................................   Passed    1.31 sec

It is time to try to repro locally. If not, I guess put on the flaky-ignore list, though it is a disturbing failure.

derekbruening commented 3 years ago

I could not reproduce this locally for 32-bit VS2017 on my Win10 2004 machine:

$ ctest --repeat-until-fail 1000 -R cbr4
<...>
    Start 125: code_api|client.cbr4
    Test #125: code_api|client.cbr4 .............   Passed    1.08 sec
    Start 125: code_api|client.cbr4
1/1 Test #125: code_api|client.cbr4 .............   Passed    1.10 sec

100% tests passed, 0 tests failed out of 1

Total Test time (real) = 1102.67 sec