OpenGVLab / VideoMamba

VideoMamba: State Space Model for Efficient Video Understanding
https://arxiv.org/abs/2403.06977
Apache License 2.0
660 stars 47 forks source link

Errors processing video files while pretraining with k400 #33

Closed pravn closed 2 months ago

pravn commented 2 months ago

I get errors stating that videos cannot be read. After cleaning up the the splits (for example - Ui0iUHNc3JM_000029_000039.mp4 has to be changed to Ui0iUHNc3JM.mp4 according to splitfiles) and copying replacement for corrupted videos, I still get errors for some videos - see below. Should I just remove these videos or is there something wrong with my video reader?


Failed to load video from /home/ubuntu/videomamba_data/kinetics-dataset/k400/train/Z1pKLe3qFM0.mp4 with error Error reading /home/ubuntu/videomamba_data/kinetics-dataset/k400/train/Z1pKLe3qFM0.mp4...
Epoch: [0]  [ 460/3756]  eta: 2:01:24  lr: 0.000000  min_lr: 0.000000  loss: 1.9616 (1.9827)  loss_pixel: 0.0000 (0.0000)  loss_clip: 1.9616 (1.9827)  loss_scale: 65536.0000 (65536.0000)  weight_decay: 0.0500 (0.0500)  grad_norm: 1.4810 (1.5078)  time: 2.1807 (max: 7.3418)  data: 0.3901 (max: 5.5519)  max mem: 16188
[20:44:48] /github/workspace/src/video/video_reader.cc:83: ERROR opening: /home/ubuntu/videomamba_data/kinetics-dataset/k400/train/GYjzaBtvuzY.mp4, No such file or directory
Failed to load video from /home/ubuntu/videomamba_data/kinetics-dataset/k400/train/GYjzaBtvuzY.mp4 with error Error reading /home/ubuntu/videomamba_data/kinetics-dataset/k400/train/GYjzaBtvuzY.mp4...```
Andy1621 commented 2 months ago

Hi, if there are only a few error videos, I think you can remove them. Besides, our K400 data can be found here.