search

sx-aurora-dev / llvm-project

llvm-project cloned from https://github.com/llvm/llvm-project and modified for VE
Other
16 stars 8 forks source link

Known issues from nightly test #38

Open kaz7 opened 3 years ago

kaz7 commented 3 years ago

We have following known issues. All of them are related to VE's hardware implementation.

FAIL: MultiSource/Applications/minisat/minisat.execution_time (504 of 2515)
FAIL: MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt.execution_time (505 of 2515)
FAIL: SingleSource/Regression/C/uint64_to_float.execution_time (506 of 2515)
kaz7 commented 3 years ago

After #32, we have following additional issues. I guess these are caused by upstream changes in C++ EH implementation. I'll check them once we merge whole upstream.

FAIL: MultiSource/UnitTests/C++11/frame_layout/frame_layout.execution_time (506 of 2515)
FAIL: SingleSource/Benchmarks/Shootout-C++/EH/except.execution_time (507 of 2515)
FAIL: SingleSource/Regression/C++/EH/class_hierarchy.execution_time (508 of 2515)
FAIL: SingleSource/Regression/C++/EH/ctor_dtor_count.execution_time (509 of 2515)
FAIL: SingleSource/Regression/C++/EH/ctor_dtor_count-2.execution_time (510 of 2515)
FAIL: SingleSource/Regression/C++/EH/exception_spec_test.execution_time (511 of 2515)
FAIL: SingleSource/Regression/C++/EH/function_try_block.execution_time (512 of 2515)
FAIL: SingleSource/Regression/C++/EH/inlined_cleanup.execution_time (513 of 2515)
FAIL: SingleSource/Regression/C++/EH/recursive-throw.execution_time (514 of 2515)
FAIL: SingleSource/Regression/C++/EH/simple_rethrow.execution_time (515 of 2515)
FAIL: SingleSource/Regression/C++/EH/simple_throw.execution_time (516 of 2515)
FAIL: SingleSource/Regression/C++/EH/throw_rethrow_test.execution_time (517 of 2515)
kaz7 commented 3 years ago

exception problem is fixed already.

kaz7 commented 2 years ago

The latest develop branch, 5f71ea2, fails following test cases with -O0 option. minisat, uint64_to_float, and reductions-flt are known to fail because SX-Aurora hardware doesn't support denormalized numbers which are used in these test cases. However, UnitTests/Vector/multiplies is new. We need to inspect the reason of this.

--- Tested: 2515 tests --
FAIL: SingleSource/UnitTests/Vector/multiplies.compile_time (1 of 2515)
FAIL: MultiSource/Applications/minisat/minisat.execution_time (504 of 2515)
FAIL: MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt.execution_time (505 of 2515)
FAIL: SingleSource/Regression/C/uint64_to_float.execution_time (506 of 2515)
FAIL: SingleSource/UnitTests/Vector/multiplies.execution_time (507 of 2515)
Processing Times
----------------
Load   : 0.00s
Import : 0.08s
Report : 0.51s
Total  : 0.52s

Imported Data
-------------
Added Machines: 1
Added Runs    : 1
Added Tests   : 503

Results
----------------
FAIL : 5
PASS : 2510
kaz7 commented 2 years ago

And, the latest develop branch, 5f71ea2, fails following test cases with -O3 option. stepanov_vector is also new error.

FAIL: MultiSource/Applications/minisat/minisat.execution_time (504 of 2515)
FAIL: MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt.execution_time (505 of 2515)
FAIL: SingleSource/Benchmarks/Adobe-C++/stepanov_vector.execution_time (506 of 2515)
FAIL: SingleSource/Regression/C/uint64_to_float.execution_time (507 of 2515)