pytorch / vision

Datasets, Transforms and Models specific to Computer Vision
https://pytorch.org/vision
BSD 3-Clause "New" or "Revised" License
16.01k stars 6.93k forks source link

`video_reader` core dumps on specific video #6204

Open datumbox opened 2 years ago

datumbox commented 2 years ago

🐛 Describe the bug

from torchvision.io import read_video
from torchvision import set_video_backend

path = "./3caPS4FHFF8_000036_000046.mp4"

set_video_backend("pyav")
video, audio, info = read_video(path)
print("pyav OK")

set_video_backend("video_reader")
video, audio, info = read_video(path)
print("video_reader OK")

Output:

PyAV OK
malloc(): memory corruption
Aborted (core dumped)

The video file is part of Kinetics400. You can download it from here. Other videos pass.

Dump from gdb:

malloc(): memory corruption

Thread 1 "python" received signal SIGABRT, Aborted.
__GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
51  ../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
(gdb) bt
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x00007ffff705e7f1 in __GI_abort () at abort.c:79
#2  0x00007ffff70a7837 in __libc_message (action=action@entry=do_abort, fmt=fmt@entry=0x7ffff71d4a7b "%s\n") at ../sysdeps/posix/libc_fatal.c:181
#3  0x00007ffff70ae8ba in malloc_printerr (str=str@entry=0x7ffff71d2cfc "malloc(): memory corruption") at malloc.c:5342
#4  0x00007ffff70b2a04 in _int_malloc (av=av@entry=0x7ffff7409c40 <main_arena>, bytes=bytes@entry=8304) at malloc.c:3748
#5  0x00007ffff70b355b in _int_memalign (av=0x7ffff7409c40 <main_arena>, alignment=64, bytes=<optimized out>) at malloc.c:4683
#6  0x00007ffff70b8fda in _mid_memalign (address=<optimized out>, bytes=8192, alignment=<optimized out>) at malloc.c:3324
#7  __posix_memalign (memptr=0x7fffffff9ca0, alignment=<optimized out>, size=8192) at malloc.c:5361
#8  0x00007ffec8079d76 in av_malloc () from ~/conda/envs/slowfast/lib/libavutil.so.56
#9  0x00007ffec806664a in av_buffer_alloc () from ~/conda/envs/slowfast/lib/libavutil.so.56
#10 0x00007ffec8066d34 in av_buffer_pool_get () from ~/conda/envs/slowfast/lib/libavutil.so.56
#11 0x00007ffec8786ac6 in avcodec_default_get_buffer2 () from ~/conda/envs/slowfast/lib/libavcodec.so.58
#12 0x00007ffec878762b in ?? () from ~/conda/envs/slowfast/lib/libavcodec.so.58
#13 0x00007ffec863323d in ?? () from ~/conda/envs/slowfast/lib/libavcodec.so.58
#14 0x00007ffec8639ff5 in ?? () from ~/conda/envs/slowfast/lib/libavcodec.so.58
#15 0x00007ffec863c0fe in ?? () from ~/conda/envs/slowfast/lib/libavcodec.so.58
#16 0x00007ffec8784590 in ?? () from ~/conda/envs/slowfast/lib/libavcodec.so.58
#17 0x00007ffec8785278 in avcodec_send_packet () from ~/conda/envs/slowfast/lib/libavcodec.so.58
#18 0x00007ffec9a58c02 in ffmpeg::Stream::analyzePacket(AVPacket const*, bool*) () from ~/repos/vision/torchvision/video_reader.so
#19 0x00007ffec9a59081 in ffmpeg::Stream::decodePacket(AVPacket const*, ffmpeg::DecoderOutputMessage*, bool, bool*) () from ~/repos/vision/torchvision/video_reader.so
#20 0x00007ffec9a543ee in ffmpeg::Decoder::processPacket(ffmpeg::Stream*, AVPacket*, bool*, bool*, bool) () from ~/repos/vision/torchvision/video_reader.so
#21 0x00007ffec9a5499a in ffmpeg::Decoder::getFrame(unsigned long) () from ~/repos/vision/torchvision/video_reader.so
#22 0x00007ffec9a5a6e1 in ffmpeg::SyncDecoder::decode(ffmpeg::DecoderOutputMessage*, unsigned long) () from ~/repos/vision/torchvision/video_reader.so
#23 0x00007ffec9a865bd in vision::video_reader::(anonymous namespace)::readVideo(bool, at::Tensor const&, std::string, double, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long) ()
   from ~/repos/vision/torchvision/video_reader.so
#24 0x00007ffec9a88549 in vision::video_reader::read_video_from_file(std::string, double, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long) ()
   from ~/repos/vision/torchvision/video_reader.so
#25 0x00007ffec9a8b3be in std::decay<c10::guts::infer_function_traits<c10::impl::detail::WrapFunctionIntoRuntimeFunctor_<c10::List<at::Tensor> (*)(std::string, double, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long), c10::List<at::Tensor>, c10::guts::typelist::typelist<std::string, double, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long> > >::type::return_type>::type c10::impl::call_functor_with_args_from_stack_<c10::impl::detail::WrapFunctionIntoRuntimeFunctor_<c10::List<at::Tensor> (*)(std::string, double, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long), c10::List<at::Tensor>, c10::guts::typelist::typelist<std::string, double, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long> >, false, 0ul, 1ul, 2ul, 3ul, 4ul, 5ul, 6ul, 7ul, 8ul, 9ul, 10ul, 11ul, 12ul, 13ul, 14ul, 15ul, 16ul, 17ul, 18ul, std::string, double, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long>(c10::OperatorKernel*, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*, std::integer_sequence<unsigned long, 0ul, 1ul, 2ul, 3ul, 4ul, 5ul, 6ul, 7ul, 8ul, 9ul, 10ul, 11ul, 12ul, 13ul, 14ul, 15ul, 16ul, 17ul, 18ul>, c10::guts::typelist::typelist<std::string, double, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long>*) () from ~/repos/vision/torchvision/video_reader.so
#26 0x00007ffec9a8b4f2 in c10::impl::make_boxed_from_unboxed_functor<c10::impl::detail::WrapFunctionIntoRuntimeFunctor_<c10::List<at::Tensor> (*)(std::string, double, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long), c10::List<at::Tensor>, c10::guts::typelist::typelist<std::string, double, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long, long> >, false>::call(c10::OperatorKernel*, c10::OperatorHandle const&, c10::DispatchKeySet, std::vector<c10::IValue, std::allocator<c10::IValue> >*) () from ~/repos/vision/torchvision/video_reader.so
#27 0x00007fff4eeb95d0 in c10::Dispatcher::callBoxed(c10::OperatorHandle const&, std::vector<c10::IValue, std::allocator<c10::IValue> >*) const () from ~/conda/lib/python3.9/site-packages/torch/lib/libtorch_cpu.so
#28 0x00007fffc62202b4 in torch::jit::invokeOperatorFromPython(std::vector<std::shared_ptr<torch::jit::Operator>, std::allocator<std::shared_ptr<torch::jit::Operator> > > const&, pybind11::args, pybind11::kwargs const&) ()
   from ~/conda/lib/python3.9/site-packages/torch/lib/libtorch_python.so
#29 0x00007fffc61f872c in torch::jit::initJITBindings(_object*)::{lambda(std::string const&)#136}::operator()(std::string const&) const::{lambda(pybind11::args, {lambda(std::string const&)#136}::kwargs)#1}::operator()(pybind11, pybind11::args) const ()
   from ~/conda/lib/python3.9/site-packages/torch/lib/libtorch_python.so
#30 0x00007fffc61f8f03 in void pybind11::cpp_function::initialize<torch::jit::initJITBindings(_object*)::{lambda(std::string const&)#136}::operator()(std::string const&) const::{lambda(pybind11::args, pybind11::kwargs)#1}, pybind11::object, {lambda(std::string const&)#136}, pybind11::args, pybind11::name, pybind11::doc>(torch::jit::initJITBindings(_object*)::{lambda(std::string const&)#136}::operator()(std::string const&) const::{lambda(pybind11::args, pybind11::kwargs)#1}&&, pybind11::object (*)({lambda(std::string const&)#136}, pybind11::args), pybind11::name const&, pybind11::doc const&)::{lambda(pybind11::detail::function_call&)#3}::_FUN(pybind11::detail) () from ~/conda/lib/python3.9/site-packages/torch/lib/libtorch_python.so
#31 0x00007fffc5ed98a4 in pybind11::cpp_function::dispatcher(_object*, _object*, _object*) () from ~/conda/lib/python3.9/site-packages/torch/lib/libtorch_python.so
#32 0x000055555569ae64 in cfunction_call () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Objects/methodobject.c:539
#33 0x00005555556947e4 in _PyObject_Call () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Objects/call.c:281
#34 0x0000555555725bc3 in PyObject_Call (kwargs=0x7ffff6dbce40, args=0x7ffeb8a66b80, callable=0x7ffeb89ff9a0) at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Objects/call.c:293
#35 do_call_core (kwdict=0x7ffff6dbce40, callargs=0x7ffeb8a66b80, func=0x7ffeb89ff9a0, tstate=<optimized out>) at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:5092
#36 _PyEval_EvalFrameDefault () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:3580
#37 0x00005555556dab32 in _PyEval_EvalFrame () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Include/internal/pycore_ceval.h:40
#38 _PyEval_EvalCode () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:4327
#39 0x00005555556db697 in _PyFunction_Vectorcall () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Objects/call.c:396
#40 0x00005555556cb60a in _PyObject_FastCallDictTstate () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Objects/call.c:118
#41 0x00005555556cba63 in _PyObject_Call_Prepend (kwargs=0x0, args=0x7ffeb8a66ac0, obj=0x7ffeb8a3c850, callable=0x7ffecb061670, tstate=0x5555559108c0) at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Objects/call.c:489
#42 slot_tp_call () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Objects/typeobject.c:6703
#43 0x0000555555694e4f in _PyObject_MakeTpCall () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Objects/call.c:191
#44 0x0000555555724e29 in _PyObject_VectorcallTstate (kwnames=0x0, nargsf=<optimized out>, args=0x555566d12818, callable=<optimized out>, tstate=<optimized out>)
    at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Include/cpython/abstract.h:116
#45 PyObject_Vectorcall () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Include/cpython/abstract.h:127
#46 call_function (kwnames=0x0, oparg=<optimized out>, pp_stack=<synthetic pointer>, tstate=0x5555559108c0) at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:5072
#47 _PyEval_EvalFrameDefault () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:3487
---Type <return> to continue, or q <return> to quit---
#48 0x00005555556dab32 in _PyEval_EvalFrame () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Include/internal/pycore_ceval.h:40
#49 _PyEval_EvalCode () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:4327
#50 0x00005555556db697 in _PyFunction_Vectorcall () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Objects/call.c:396
#51 0x0000555555652f00 in _PyObject_VectorcallTstate (kwnames=0x7ffeca7c7280, nargsf=<optimized out>, args=<optimized out>, callable=0x7ffeca253700, tstate=<optimized out>)
    at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Include/cpython/abstract.h:118
#52 PyObject_Vectorcall () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Include/cpython/abstract.h:127
#53 call_function (kwnames=0x7ffeca7c7280, oparg=<optimized out>, pp_stack=<synthetic pointer>, tstate=<optimized out>) at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:5072
#54 _PyEval_EvalFrameDefault (tstate=<optimized out>, f=0x55555f7aed50, throwflag=<optimized out>) at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:3535
#55 0x00005555556dad2b in _PyEval_EvalFrame () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Include/internal/pycore_ceval.h:40
#56 _PyEval_EvalCode () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:4327
#57 0x00005555556db697 in _PyFunction_Vectorcall () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Objects/call.c:396
#58 0x00005555556531ca in _PyObject_VectorcallTstate (kwnames=0x0, nargsf=<optimized out>, args=0x555558c72b48, callable=0x7ffeca253a60, tstate=<optimized out>)
    at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Include/cpython/abstract.h:118
#59 PyObject_Vectorcall () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Include/cpython/abstract.h:127
#60 call_function (kwnames=0x0, oparg=<optimized out>, pp_stack=<synthetic pointer>, tstate=0x5555559108c0) at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:5072
#61 _PyEval_EvalFrameDefault (tstate=<optimized out>, f=0x555558c72950, throwflag=<optimized out>) at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:3487
#62 0x00005555556dab32 in _PyEval_EvalFrame () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Include/internal/pycore_ceval.h:40
#63 _PyEval_EvalCode () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:4327
#64 0x00005555556db697 in _PyFunction_Vectorcall () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Objects/call.c:396
#65 0x00005555556533be in _PyObject_VectorcallTstate (kwnames=0x0, nargsf=<optimized out>, args=0x55555596dd20, callable=0x7ffeca259820, tstate=<optimized out>)
    at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Include/cpython/abstract.h:118
#66 PyObject_Vectorcall () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Include/cpython/abstract.h:127
#67 call_function (kwnames=0x0, oparg=<optimized out>, pp_stack=<synthetic pointer>, tstate=0x5555559108c0) at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:5072
#68 _PyEval_EvalFrameDefault (tstate=<optimized out>, f=0x55555596dbb0, throwflag=<optimized out>) at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:3518
#69 0x00005555556dab32 in _PyEval_EvalFrame () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Include/internal/pycore_ceval.h:40
#70 _PyEval_EvalCode () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:4327
#71 0x000055555578addc in _PyEval_EvalCodeWithName (qualname=0x0, name=0x0, closure=0x0, kwdefs=0x0, defcount=0, defs=0x0, kwstep=2, kwcount=0, kwargs=<optimized out>, kwnames=<optimized out>, argcount=<optimized out>, args=<optimized out>, 
    locals=<optimized out>, globals=<optimized out>, _co=<optimized out>) at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:4359
#72 PyEval_EvalCodeEx () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:4375
#73 0x00005555556dbb5b in PyEval_EvalCode (co=<optimized out>, globals=<optimized out>, locals=<optimized out>) at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/ceval.c:826
#74 0x000055555578ae8b in run_eval_code_obj () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/pythonrun.c:1219
#75 0x00005555557bb215 in run_mod () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/pythonrun.c:1240
#76 0x0000555555666677 in pyrun_file (fp=0x5555559766c0, filename=0x7ffff6ec3ab0, start=<optimized out>, globals=0x7ffff6f53480, locals=0x7ffff6f53480, closeit=1, flags=0x7fffffffce28)
    at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/pythonrun.c:1138
#77 0x00005555557bfcef in pyrun_simple_file (flags=0x7fffffffce28, closeit=1, filename=0x7ffff6ec3ab0, fp=0x5555559766c0) at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/pythonrun.c:449
#78 PyRun_SimpleFileExFlags () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Python/pythonrun.c:482
#79 0x00005555557c03b8 in pymain_run_file (cf=0x7fffffffce28, config=0x5555559116d0) at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Modules/main.c:379
#80 pymain_run_python (exitcode=0x7fffffffce20) at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Modules/main.c:604
#81 Py_RunMain () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Modules/main.c:683
#82 0x00005555557c05b9 in Py_BytesMain () at /home/builder/ktietz/cos6/ci_cos6/python-split_1622827272909/work/Modules/main.c:1129
#83 0x00007ffff703fc87 in __libc_start_main (main=0x55555566e430 <main>, argc=2, argv=0x7fffffffd018, init=<optimized out>, fini=<optimized out>, rtld_fini=<optimized out>, stack_end=0x7fffffffd008) at ../csu/libc-start.c:310
#84 0x0000555555748a64 in _start ()

Versions

Latest main branch.

Collecting environment information...
PyTorch version: 1.12.0.dev20220223
Is debug build: False
CUDA used to build PyTorch: 11.1
ROCM used to build PyTorch: N/A

OS: Ubuntu 18.04.6 LTS (x86_64)
GCC version: (Ubuntu 7.5.0-3ubuntu1~18.04) 7.5.0
Clang version: 6.0.0-1ubuntu2 (tags/RELEASE_600/final)
CMake version: version 3.19.6
Libc version: glibc-2.27

Python version: 3.9.5 (default, Jun  4 2021, 12:28:51)  [GCC 7.5.0] (64-bit runtime)
Python platform: Linux-5.4.0-1069-aws-x86_64-with-glibc2.27
Is CUDA available: False
CUDA runtime version: 11.1.105
GPU models and configuration: Could not collect
Nvidia driver version: Could not collect
cuDNN version: Probably one of the following:
/usr/local/cuda-11.0/targets/x86_64-linux/lib/libcudnn.so.8.0.5
/usr/local/cuda-11.0/targets/x86_64-linux/lib/libcudnn_adv_infer.so.8.0.5
/usr/local/cuda-11.0/targets/x86_64-linux/lib/libcudnn_adv_train.so.8.0.5
/usr/local/cuda-11.0/targets/x86_64-linux/lib/libcudnn_cnn_infer.so.8.0.5
/usr/local/cuda-11.0/targets/x86_64-linux/lib/libcudnn_cnn_train.so.8.0.5
/usr/local/cuda-11.0/targets/x86_64-linux/lib/libcudnn_ops_infer.so.8.0.5
/usr/local/cuda-11.0/targets/x86_64-linux/lib/libcudnn_ops_train.so.8.0.5
/usr/local/cuda-11.1/targets/x86_64-linux/lib/libcudnn.so.8.0.5
/usr/local/cuda-11.1/targets/x86_64-linux/lib/libcudnn_adv_infer.so.8.0.5
/usr/local/cuda-11.1/targets/x86_64-linux/lib/libcudnn_adv_train.so.8.0.5
/usr/local/cuda-11.1/targets/x86_64-linux/lib/libcudnn_cnn_infer.so.8.0.5
/usr/local/cuda-11.1/targets/x86_64-linux/lib/libcudnn_cnn_train.so.8.0.5
/usr/local/cuda-11.1/targets/x86_64-linux/lib/libcudnn_ops_infer.so.8.0.5
/usr/local/cuda-11.1/targets/x86_64-linux/lib/libcudnn_ops_train.so.8.0.5
/usr/local/cuda-11.2/targets/x86_64-linux/lib/libcudnn.so.8.1.1
/usr/local/cuda-11.2/targets/x86_64-linux/lib/libcudnn_adv_infer.so.8.1.1
/usr/local/cuda-11.2/targets/x86_64-linux/lib/libcudnn_adv_train.so.8.1.1
/usr/local/cuda-11.2/targets/x86_64-linux/lib/libcudnn_cnn_infer.so.8.1.1
/usr/local/cuda-11.2/targets/x86_64-linux/lib/libcudnn_cnn_train.so.8.1.1
/usr/local/cuda-11.2/targets/x86_64-linux/lib/libcudnn_ops_infer.so.8.1.1
/usr/local/cuda-11.2/targets/x86_64-linux/lib/libcudnn_ops_train.so.8.1.1
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

Versions of relevant libraries:
[pip3] mypy==0.910
[pip3] mypy-extensions==0.4.3
[pip3] numpy==1.20.3
[pip3] pytorchvideo==0.1.5
[pip3] torch==1.12.0.dev20220223
[pip3] torchdata==0.4.0a0+e8b010b
[pip3] torchvision==0.14.0a0+8cd742a
[conda] blas                      1.0                         mkl  
[conda] cudatoolkit               11.1.74              h6bb024c_0    nvidia
[conda] magma-cuda110             2.5.2                         1    pytorch
[conda] mkl                       2021.3.0           h06a4308_520  
[conda] mkl-include               2021.3.0           h06a4308_520  
[conda] mkl-service               2.4.0            py39h7f8727e_0  
[conda] mkl_fft                   1.3.0            py39h42c9631_2  
[conda] mkl_random                1.2.2            py39h51133e4_0  
[conda] numpy                     1.20.3           py39hf144106_0  
[conda] numpy-base                1.20.3           py39h74d4b33_0  
[conda] pytorch                   1.12.0.dev20220223 py3.9_cuda11.1_cudnn8.0.5_0    pytorch-nightly
[conda] pytorch-mutex             1.0                        cuda    pytorch-nightly
[conda] pytorchvideo              0.1.5                    pypi_0    pypi
[conda] torch                     1.11.0.dev20211020+cu111          pypi_0    pypi
[conda] torchdata                 0.4.0a0+e8b010b          pypi_0    pypi
[conda] torchvision               0.14.0a0+8cd742a           dev_0    <develop>
datumbox commented 2 years ago

Potentially related or duplicate to #5419

bjuncek commented 2 years ago

Hi all, So I've dug quite a bit into this for the past two weeks (and am continuing to do so), and there are a few confusing factors. The error, to the best of my tracebacks is coming the fact that returned data from FFMPEG is larger than the allocated tensor (which should be guaranteed based on the headers), but there is some sort of a mismatch.

what I can't seem to figure out is why that is happening. I've tried hi-res videos, didn't have an issue, but then a video from #6204 does. The codec looks the same as some other videos, and it passes the ffprobe without an issue.

I've been getting some help from collegues at QS so hopefully will be able to get to the bottom of this.

jdsgomes commented 2 years ago

Just for reference I can decode the video successfully on a different environment than @datumbox

Collecting environment information...
PyTorch version: 1.12.0
Is debug build: False
CUDA used to build PyTorch: None
ROCM used to build PyTorch: N/A

OS: macOS 12.3.1 (x86_64)
GCC version: Could not collect
Clang version: 13.0.0
CMake version: version 3.21.4
Libc version: N/A

Python version: 3.9.12 (main, Jun  1 2022, 06:36:29)  [Clang 12.0.0 ] (64-bit runtime)
Python platform: macOS-10.16-x86_64-i386-64bit
Is CUDA available: False
CUDA runtime version: No CUDA
GPU models and configuration: No CUDA
Nvidia driver version: No CUDA
cuDNN version: No CUDA
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

Versions of relevant libraries:
[pip3] mypy==0.961
[pip3] mypy-extensions==0.4.3
[pip3] numpy==1.23.0rc3
[pip3] torch==1.12.0
[pip3] torchaudio==0.12.0
[pip3] torchvision==0.14.0a0+8068594
[conda] blas                      1.0                         mkl
[conda] mkl                       2022.0.0           hecd8cb5_105
[conda] numpy                     1.23.0rc3                pypi_0    pypi
[conda] torch                     1.12.0                   pypi_0    pypi
[conda] torchaudio                0.12.0                   pypi_0    pypi
[conda] torchvision               0.14.0a0+8068594           dev_0    <develop>