search

ArrowLuo / CLIP4Clip

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"
https://arxiv.org/abs/2104.08860
MIT License
879 stars 123 forks source link

MSR-VTT dataset error #44

Closed xmu-xiaoma666 closed 2 years ago

xmu-xiaoma666 commented 2 years ago

when I using MSRVTT dataset, some errors happened, log is "video path: /home/admin/workspace/workgroup/mayiwei.myw/data/MSRVTT/data/MSRVTT/videos/all/video5397.mp4 error. video id:video5397" image do you kown what is wrong

ArrowLuo commented 2 years ago

Hi @xmu-xiaoma666, this prompt is caused by this line. I think two factors will cause such an error, 1) the video is not found, 2) the video is damaged. If nothing is wrong with the video, a suggestion is to debug the line and the RawVideoExtractor itself.

shirlyliu commented 2 years ago

I have the same mistakes. Would you finally solve this problem? What's wrong with these videos？The raw_video_data's shapes of these videos are [1] causing the error. However, I have tired to make a demo.py to check the wrong videos independently. The raw_video_data's shapes of these videos are more than 3 proving there is nothing wrong with the raw videos. I have no idea to solve this problem.

ArrowLuo commented 2 years ago

Hi @shirlyliu, do you mean your demo.py can extract the right tensor from these wrong videos? If so, a not wise approach is to set video_path at here with a wrong video arbitrarily, then print the shape. Maybe something wrong in rawvideo_util.py.