[Bug] long-video-demo raised AssertionError on assert crop_h == img_h or crop_w == img_w

vba34520 commented 9 months ago

Branch

main branch (1.x version, such as v1.0.0, or dev-1.x branch)

Prerequisite

[X] I have searched Issues and Discussions but cannot get the expected help.
[X] I have read the documentation but cannot get the expected help.
[X] The bug has not been fixed in the latest version.

Environment

sys.platform: win32 Python: 3.8.10 (tags/v3.8.10:3d8993a, May 3 2021, 11:48:03) [MSC v.1928 64 bit (AMD64)] CUDA available: True MUSA available: False numpy_random_seed: 2147483648 GPU 0: NVIDIA GeForce RTX 3060 Laptop GPU CUDA_HOME: C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.1 NVCC: Cuda compilation tools, release 11.1, V11.1.74 MSVC: 用于 x64 的 Microsoft (R) C/C++ 优化编译器 19.29.30153 版 GCC: n/a PyTorch: 1.12.1+cu113 PyTorch compiling details: PyTorch built with:

C++ Version: 199711
MSVC 192829337
Intel(R) Math Kernel Library Version 2020.0.2 Product Build 20200624 for Intel(R) 64 architecture applications
Intel(R) MKL-DNN v2.6.0 (Git Hash 52b5f107dd9cf10910aaa19cb47f3abf9b349815)
OpenMP 2019
LAPACK is enabled (usually provided by MKL)
CPU capability usage: AVX2
CUDA Runtime 11.3
NVCC architecture flags: -gencode;arch=compute_37,code=sm_37;-gencode;arch=compute_50,code=sm_50;-gencode;arch=compute_60,code=sm_60;-gencode;arch=compute_61,code=sm_61;-gencode;arch=compute_70,code=sm_70;-gencode;arch=compute_75,code=sm_75;-gencode;arch=compute80,code=sm 80;-gencode;arch=compute_86,code=sm_86;-gencode;arch=compute_37,code=compute_37
CuDNN 8.3.2 (built against CUDA 11.5)
Magma 2.5.4
Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, CUDA_VERSION=11.3, CUDNN_VERSION=8.3.2, CXX_COMPILER=C:/actions-runner/_work/pytorch/pytorch/builder/windows/tmp_bin/sccache-cl.exe, CXX_FLAGS=/DWIN32 /D_WINDOWS /GR /EHsc /w /bigobj -DUSE_PTHREADPOOL -openmp:experimental - IC:/actions-runner/_work/pytorch/pytorch/builder/windows/mkl/include -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DUSE_FBGEMM -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -DEDGE_PROFILER_USE_KINETO, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, PERF_WITHAVX512=1, TORCH VERSION=1.12.1, USE_CUDA=ON, USE_CUDNN=ON, USE_EXCEPTION_PTR=1, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_MKL=ON, USE_MKLDNN=OFF, USE_MPI=OFF, USE_NCCL=OFF, USE_NNPACK=OFF, USE_OPENMP=ON, USE_ROCM=OFF,

TorchVision: 0.13.1+cu113 OpenCV: 4.9.0 MMEngine: 0.10.3 MMAction2: 1.2.0+4d6c934 MMCV: 2.1.0 MMDetection: 3.3.0

Describe the bug

At long-video-demo

python demo/long_video_demo.py configs/recognition/i3d/i3d_imagenet-pretrained-r50_8xb8-32x2x1-100e_kinetics400-rgb.py \
  checkpoints/i3d_imagenet-pretrained-r50_8xb8-32x2x1-100e_kinetics400-rgb_20220812-e213c223.pth PATH_TO_LONG_VIDEO tools/data/kinetics/label_map_k400.txt PATH_TO_SAVED_VIDEO \
  --label-color 255 255 0

not suitable for my video with 1920×1080.

It raised AssertionError:

  File "demo/long_video_demo.py", line 270, in <module>
    main()
  File "demo/long_video_demo.py", line 266, in main
    show_results(model, data, label, args)
  File "demo/long_video_demo.py", line 172, in show_results
    ret, scores = inference(model, data, args, frame_queue)
  File "demo/long_video_demo.py", line 217, in inference
    result = inference_recognizer(
  File "d:\mycode\mmaction2\mmaction\apis\inference.py", line 105, in inference_recognizer
    data = test_pipeline(data)
  File "C:\Users\Administrator\Envs\test\lib\site-packages\mmengine\dataset\base_dataset.py", line 60, in __call__
    data = t(data)
  File "C:\Users\Administrator\Envs\test\lib\site-packages\mmcv\transforms\base.py", line 12, in __call__
    return self.transform(results)
  File "d:\mycode\mmaction2\mmaction\datasets\transforms\processing.py", line 1168, in transform
    assert crop_h == img_h or crop_w == img_w

Thanks a lot.

Reproduces the problem - code sample

No response

Reproduces the problem - command or script

No response

Reproduces the problem - error message

No response

Additional information

No response

fengjingchehu commented 8 months ago

i wonder how can i get files like checkpoints/i3d_imagenet-pretrained-r50_8xb8-32x2x1-100e_kinetics400-rgb_20220812-e213c223.pth ?

deeperrrr commented 8 months ago

i wonder how can i get files like checkpoints/i3d_imagenet-pretrained-r50_8xb8-32x2x1-100e_kinetics400-rgb_20220812-e213c223.pth ?我想知道如何获取像 checkpoints/i3d_imagenet-pretrained-r50_8xb8-32x2x1-100e_kinetics400-rgb_20220812-e213c223.pth 这样的文件？

is here~ https://download.openmmlab.com/mmaction/v1.0/recognition/i3d/i3d_imagenet-pretrained-r50_8xb8-32x2x1-100e_kinetics400-rgb/i3d_imagenet-pretrained-r50_8xb8-32x2x1-100e_kinetics400-rgb_20220812-e213c223.pth

fengjingchehu commented 8 months ago

Thank you for sharing ！

fengjingchehu commented 8 months ago

god, i meet the same question. File "mmaction2-main/mmaction/datasets/transforms/processing.py", line 1168, in transform assert crop_h == img_h or crop_w == img_w AssertionError

This should be a matter of video size.

St4r4x commented 7 months ago

This issue occurs when using the ThreeCrop method with the longvideodemo script. I resolved this issue by modifying the crop method in the configuration file.

PopGreen69 commented 6 months ago

@St4r4x Hi, may I ask the details about how modify the crop method in the configuration file?

St4r4x commented 6 months ago

I replaced ThreeCrop method by CenterCrop

PopGreen69 commented 6 months ago

I replaced ThreeCrop method by CenterCrop

It works, thank you so much ! @St4r4x

Kataglyphis commented 4 months ago

The resize filter in the test_pipeline seems to be corrupt. I could fix the demo with adding manual resizing into line 209: resized_windows = [cv2.resize(frame, (224, 224)) for frame in cur_windows]

line 213 change cur_windows into resized_windows respectively.

open-mmlab / mmaction2