search

ultravideo / kvazaar

An open-source HEVC encoder
BSD 3-Clause "New" or "Revised" License
790 stars 174 forks source link

[tests] Multiple test failures with ffmpeg 4.1 #216

Open candrews opened 5 years ago

candrews commented 5 years ago

Using ffmpeg 4.1 and kvazaar 1.2.0, multiple tests fail.

PASS: kvazaar_tests
PASS: test_external_symbols.sh
PASS: test_invalid_input.sh
FAIL: test_interlace.sh
FAIL: test_gop.sh
FAIL: test_mv_constraint.sh
FAIL: test_owf_wpp_tiles.sh
FAIL: test_intra.sh
FAIL: test_rate_control.sh
FAIL: test_weird_shapes.sh
FAIL: test_tools.sh
FAIL: test_smp.sh
FAIL: test_slices.sh
============================================================================
Testsuite summary for kvazaar 1.2.0
============================================================================
# TOTAL: 13
# PASS:  3
# SKIP:  0
# XFAIL: 0
# FAIL:  10
# XPASS: 0
# ERROR: 0

build.log test results

fador commented 5 years ago

Hi,

Thanks for reporting, we will try to reproduce the behaviour and see what is going on (since we have not tested in Gentoo before). For some reason other systems seem to be behaving normally, including our Travis CI..

candrews commented 5 years ago

It looks like ffmpeg 2.6.3 (see https://github.com/ultravideo/kvazaar/blob/master/.travis-install.bash ) is being used when run in Travis CI, which is probably why this problem isn't being seen there.

candrews commented 5 years ago

why not mask USE=test on these arches instead

I think you may have meant to comment on https://github.com/gentoo/gentoo/pull/10492 instead :)

In any case, there are still tests that run without valgrind, so IMHO it's better to not mask USE=test on any arch instead removing the tests requiring valgrind. Even on a valgrind supporting arch, the valgrind tests fail because Gentoo doesn't have a sufficiently old version of ffmpeg which allows the tests to pass (which is what this issue is reporting).