search

epic-kitchens / epic-kitchens-100-annotations

:plate_with_cutlery: Annotations for the public release of the EPIC-KITCHENS-100 dataset
Other
130 stars 28 forks source link

Corrupted Videos #33

Closed ADiko1997 closed 10 months ago

ADiko1997 commented 10 months ago

Many videos from the EK100 validation set are corrupted. Some examples that I found are: P26_35, P22_03, P22_01, P18_09, P12_03, P10_03, P02_12 and P01_14. I guess those are related also to EK55.

dimadamen commented 10 months ago

That is not true... where did you download the videos from? This is where the videos are stored: https://data.bris.ac.uk/data/dataset/3h91syskeag572hl6tvuovwv4d You can even watch these on the server and see they are not corrupted and download them correctly.

ADiko1997 commented 10 months ago

Hello, I used the download script form the repo. I tried to download it several times. I can give it another shot and see if it works. Kind regards Anxhelo

On Fri, 22 Dec 2023, 12:22 Dima Damen, @.***> wrote:

That is not true... where did you download the videos from?

— Reply to this email directly, view it on GitHub https://github.com/epic-kitchens/epic-kitchens-100-annotations/issues/33#issuecomment-1867569522, or unsubscribe https://github.com/notifications/unsubscribe-auth/AL3UZJGDCXW6NL4MTYLBZB3YKVUNPAVCNFSM6AAAAABA7WH5H2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNRXGU3DSNJSGI . You are receiving this because you authored the thread.Message ID: @.*** com>

dimadamen commented 10 months ago

For example, P26_35 you noted above is available directly here: https://data.bris.ac.uk/datasets/3h91syskeag572hl6tvuovwv4d/videos/test/P26/P26_35.MP4 You can see it's not corrupted.

dimadamen commented 10 months ago

At times your connection resets and stops the download. This is probably an issue at your end, not with the script or the files.

ADiko1997 commented 10 months ago

I will download them again. Thank you very much

On Fri, 22 Dec 2023, 12:30 Dima Damen, @.***> wrote:

For example, P26_35 you noted above is available directly here:

https://data.bris.ac.uk/datasets/3h91syskeag572hl6tvuovwv4d/videos/test/P26/P26_35.MP4 You can see it's not corrupted.

— Reply to this email directly, view it on GitHub https://github.com/epic-kitchens/epic-kitchens-100-annotations/issues/33#issuecomment-1867577168, or unsubscribe https://github.com/notifications/unsubscribe-auth/AL3UZJHNEEPIS34YH4AE5F3YKVVL5AVCNFSM6AAAAABA7WH5H2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNRXGU3TOMJWHA . You are receiving this because you authored the thread.Message ID: @.*** com>

ADiko1997 commented 10 months ago

Ok, i will download all the mentioned videos 1 by 1. Kind regards

On Fri, 22 Dec 2023, 12:30 Dima Damen, @.***> wrote:

Reopened #33 https://github.com/epic-kitchens/epic-kitchens-100-annotations/issues/33 .

— Reply to this email directly, view it on GitHub https://github.com/epic-kitchens/epic-kitchens-100-annotations/issues/33#event-11325704829, or unsubscribe https://github.com/notifications/unsubscribe-auth/AL3UZJFNN4I6B7UUTBLQZOLYKVVOZAVCNFSM6AAAAABA7WH5H2VHI2DSMVQWIX3LMV45UABCJFZXG5LFIV3GK3TUJZXXI2LGNFRWC5DJN5XDWMJRGMZDKNZQGQ4DEOI . You are receiving this because you authored the thread.Message ID: <epic-kitchens/epic-kitchens-100-annotations/issue/33/issue_event/11325704829 @github.com>

ADiko1997 commented 10 months ago

Okay, so I tried to download P26_35, and it works, probably a connection error. However, there are other cases in which I am having an issue. Right now, I am downloading them all again, and if the issue is not resolved, I will report them here. P.s. most cases seem related to the test set of ek55. Thank you

dimadamen commented 10 months ago

Some files are significantly larger than others. Ensure your network does not have a timeout restriction,

ADiko1997 commented 10 months ago

Sure, I ll do that. Thank you.

On Fri, 22 Dec 2023, 15:17 Dima Damen, @.***> wrote:

Some files are significantly larger than others. Ensure your network does not have a timeout restriction,

— Reply to this email directly, view it on GitHub https://github.com/epic-kitchens/epic-kitchens-100-annotations/issues/33#issuecomment-1867738945, or unsubscribe https://github.com/notifications/unsubscribe-auth/AL3UZJFJEPQMJOOORG5IIK3YKWI7ZAVCNFSM6AAAAABA7WH5H2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNRXG4ZTQOJUGU . You are receiving this because you authored the thread.Message ID: @.*** com>

ADiko1997 commented 10 months ago

Ok, so i tried the following videos P26_30 (56MB) P26_32 (295MB) P26_34.MP4 (386 MB) P26_36 (755MB) P26_39 (205MB) P26_40 (252MB) P26_41 (420MB) downloaded using the official script with arguments --videos --specific-videos .... and files are corrupted, IDK if it is an error of mine but in the past i have tried again these files and i cant seem to have a sane version of them.

dimadamen commented 10 months ago

E.g. P26_30 should be 58.3MB, and you can see by getting the direct link: https://data.bris.ac.uk/datasets/3h91syskeag572hl6tvuovwv4d/videos/test/P26/P26_30.MP4 that indeed it's not corrupted.

Unfortunately it is difficult to debug what is wrong with your connection, but the dataset has been downloaded using these scripts 100s of times. So unfortunately I can only confirm the problem is neither with the script nor with the files. It's with your connection.

You can try to download the tar files directly from the university links here: https://data.bris.ac.uk/data/dataset/ccc55bf0b2cad7f754ad303e03bbdfb7 or via academic torrents, avoiding the script.

ADiko1997 commented 10 months ago

Thank you, I will find a way around to download them from the torrent. Kind regrads