riscv-collab / v8

Port of Google v8 engine to RISC-V.
https://github.com/v8-riscv/v8/wiki
Other
237 stars 31 forks source link

Record regression status for commit 0589d #650

Closed qjivy closed 2 years ago

qjivy commented 2 years ago

Test release build with command line:

python3 ./tools/run-tests.py -p verbose --report --variants=more,dev --outdir="$1" \
    cctest \
    unittests \
    wasm-api-tests \
    wasm-js \
    mjsunit \
    intl \
    message \
    debugger \
    inspector \
    mkgrokdump \
    wasm-spec-tests \
    fuzzer

Record the fail cases and related issues will be filed later.

qjivy commented 2 years ago

Overall pass/fail result:

===
=== 548 tests failed
===
>>> 19902 base tests produced 64026 (321%) non-filtered tests
>>> 64026 tests ran

Under "more,dev" test variant, there are 4 possible arguments would pass to "d8" or "cctest", these arguments variants are "default", "stress", " stress_incremental_marking" and " stress_incremental_marking". So when we can consider just for one variant "default". The failure of other variants are duplicate of "default" variant.

So there are total 151 failing cases 151FAILLIST, including:

131 wasm relates cases: 131WASMFAILLIST

2 test-code-generator cases ( #646 )

cctest/test-code-generator/FuzzAssembleMoveAndSwap default: FAIL
cctest/test-code-generator/FuzzAssembleSwap default: FAIL

2 test-macro-assembler cases

cctest/test-macro-assembler-riscv32/CompareI default: FAIL (#630) cctest/test-macro-assembler-riscv32/Cvt_s_ul_Trunc_ul_s default: FAIL (#631 need to review)

13 machop cases that related to PairOps (#619 #648 )

cctest/test-run-machops/RunInt32PairMul default: FAIL
cctest/test-run-machops/RunInt32PairMulUseOnlyHighWord default: FAIL
cctest/test-run-machops/RunInt32PairMulWithSharedInput default: FAIL
cctest/test-run-machops/RunInt32PairSub default: FAIL
cctest/test-run-machops/RunInt32PairSubUseOnlyHighWord default: FAIL
cctest/test-run-machops/RunInt32PairSubWithSharedInput default: FAIL
cctest/test-run-machops/RunWord32PairSar default: FAIL
cctest/test-run-machops/RunWord32PairSarUseOnlyHighWord default: FAIL
cctest/test-run-machops/RunWord32PairShl default: FAIL
cctest/test-run-machops/RunWord32PairShlUseOnlyHighWord default: FAIL
cctest/test-run-machops/RunWord32PairShlWithSharedInput default: FAIL
cctest/test-run-machops/RunWord32PairShr default: FAIL
cctest/test-run-machops/RunWord32PairShrUseOnlyHighWord default: FAIL

1 mjsunit case:

mjsunit/harmony/atomics default: FAIL (#651)

qjivy commented 2 years ago

Pass rate: 1-(151/19902)=99.24%