220 test_script test failure

honggyukim commented 7 months ago

The 220 test_script fails as follows.

$ ./runtest.py 220
Start 1 tests without worker pool

Compiler                  gcc                                           clang                                       
Runtime test case         pg             finstrument-fu fpatchable-fun  pg             finstrument-fu fpatchable-fun
------------------------: O0 O1 O2 O3 Os O0 O1 O2 O3 Os O0 O1 O2 O3 Os  O0 O1 O2 O3 Os O0 O1 O2 O3 Os O0 O1 O2 O3 Os
220 trace_script        : NG NG NG NG NG NG NG NG NG NG NG NG NG NG NG  NG NG NG NG NG NG NG NG NG NG NG NG NG NG NG

After reverting d1d20a16e225960bb65de9b6123ea7c71c5cae95, it works fine as follows.

$ ./runtest.py 220
Start 1 tests without worker pool

Compiler                  gcc                                           clang                                       
Runtime test case         pg             finstrument-fu fpatchable-fun  pg             finstrument-fu fpatchable-fun
------------------------: O0 O1 O2 O3 Os O0 O1 O2 O3 Os O0 O1 O2 O3 Os  O0 O1 O2 O3 Os O0 O1 O2 O3 Os O0 O1 O2 O3 Os
220 trace_script        : OK OK OK OK OK OK OK OK OK OK OK OK OK OK OK  OK OK OK OK OK OK OK OK OK OK OK OK OK OK OK

namhyung commented 7 months ago

Can you share the diff? My case is in the other way around.

gichoel commented 5 months ago

I ran my tests on two Ubuntu environments and got the following results:

In my two Ubuntu environments, 026d456245b441c453b7fcbe346eebfd515b4d4d is fine but commit d1d20a16e225960bb65de9b6123ea7c71c5cae95 seems to be the problem.
However, Ubuntu 22.04 LTS shows OK in yellow at 026d456245b441c453b7fcbe346eebfd515b4d4d.

in Ubuntu 20.04 LTS

$ uname -a
Linux gc-virtual-machine 5.15.0-97-generic #107~20.04.1-Ubuntu SMP Fri Feb 9 14:20:11 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

$ git checkout d1d20a1
$ make clean; make -j$(nproc)

$ ./runtest.py 220
Start 1 tests without worker pool

Compiler                  gcc                                         
Runtime test case         pg             finstrument-fu fpatchable-fun
------------------------: O0 O1 O2 O3 Os O0 O1 O2 O3 Os O0 O1 O2 O3 Os
220 trace_script        : NG NG NG NG NG NG NG NG NG NG NG NG NG NG NG

$ git checkout 026d456
$ make clean; make -j$(nproc)

$ ./runtest.py 220
Start 1 tests without worker pool

Compiler                  gcc                                         
Runtime test case         pg             finstrument-fu fpatchable-fun
------------------------: O0 O1 O2 O3 Os O0 O1 O2 O3 Os O0 O1 O2 O3 Os
220 trace_script        : OK OK OK OK OK OK OK OK OK OK OK OK OK OK OK

in Ubuntu 22.04 LTS

$ uname -a
Linux gc-virtual-machine 6.2.0-26-generic #26~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Thu Jul 13 16:27:29 UTC 2 x86_64 x86_64 x86_64 GNU/Linux

$ git checkout d1d20a1
$ make clean; make -j$(nproc)

$ ./runtest.py 220
Start 1 tests without worker pool

Compiler                  gcc                                           clang
Runtime test case         pg             finstrument-fu fpatchable-fun  pg             finstrument-fu fpatchable-fun
------------------------: O0 O1 O2 O3 Os O0 O1 O2 O3 Os O0 O1 O2 O3 Os  O0 O1 O2 O3 Os O0 O1 O2 O3 Os O0 O1 O2 O3 Os
220 trace_script        : NG NG NG NG NG NG NG NG NG NG NG NG NG NG NG  NG NG NG NG NG NG NG NG NG NG NG NG NG NG NG

$ git checkout 026d456
$ make clean; make -j$(nproc)

$ ./runtest.py 220
Compiler                  gcc                                           clang
Runtime test case         pg             finstrument-fu fpatchable-fun  pg             finstrument-fu fpatchable-fun
------------------------: O0 O1 O2 O3 Os O0 O1 O2 O3 Os O0 O1 O2 O3 Os  O0 O1 O2 O3 Os O0 O1 O2 O3 Os O0 O1 O2 O3 Os
220 trace_script        : OK OK OK OK OK OK OK OK OK OK OK OK OK OK OK  OK OK OK OK OK OK OK OK OK OK OK OK OK OK OK

namhyung / uftrace

220 test_script test failure #1901