MKLab-ITI / visil

Authors official PyTorch implementation of the "ViSiL: Fine-grained Spatio-Temporal Video Similarity Learning" [ICCV 2019]
Apache License 2.0
205 stars 39 forks source link

Some special cases when video is loaded #6

Closed Jo-won closed 3 years ago

Jo-won commented 4 years ago

Some video links were not valid in the FIVR-5k data set, and I was looking for invalid videos other than them.

Then I found that the number of videos that were successfully downloaded and evaluated using the proposed evaluation code was not the same. (4055-were successfully downloaded, 4035-evaluated)

While trying to determine the cause of this, in the data loader, i confirmed that the first frame of some video was read from the second iteration rather than from the first iteration, in which case the algorithm in the code excluded it from the evaluation.

In this case, I would like to ask you whether i should evaluate it without special cases like the algorithm of the current code or by modifying the code to include special cases.

Explanation of special cases

(code path : datasets/init.py - line 23 func. load_video) In the algorithm of the code, when first read is False, got break. Here special cases below (column 0: iteration index, column 1: Variable 'ret' stored readable or not) image

Jo-won commented 4 years ago

+) I found another special case, "YBuSs6mqSxQ" image

gkordo commented 3 years ago

There should be an issue with the particular video files. They might be corrupted. Could you please try to re-download the videos that are not loaded and try again?

Also, for video loading, the ret variable is not used as I found it to have several issues. Instead, every loaded frame is asserted to be of type np.ndarray.