search

cvdfoundation / kinetics-dataset

716 stars 92 forks source link

No held-out test in Kinetics-600 #10

Open frankrao opened 2 years ago

frankrao commented 2 years ago

image

I have downloaded all the videos in https://s3.amazonaws.com/kinetics/600/test/k600_test_path.txt, but found the "held-out test set" missing. There are 72,924 videos in https://s3.amazonaws.com/kinetics/600/annotations/test.csv, but only 59,608 downloaded.

Could you help us how to get the held-out test set in Kinetics-600? Thanks! @kinetics-cvdf

RyanLiut commented 2 years ago

I also want to download the held-out test set. +1

kinetics-cvdf commented 2 years ago

We have added the list of links for the held-out test set.

frankrao commented 2 years ago

@kinetics-cvdf Thanks for your rely!

I see kinetics600_holdout_test.csv is added, but it's an annotation file, NOT a video downloading path. We still don't know how to download the holdout_test videos. What we need is a holdout_test path file like k600_test_path.txt

We tried to download these videos from youtube using youtube_id, but there are more than 15% videos removed.

We have added the list of links for the held-out test set.

kinetics-cvdf commented 2 years ago

Have you checked if the videos are contained in the existing downloadable k600 files ?

frankrao commented 2 years ago

Have you checked if the videos are contained in the existing downloadable k600 files ?

Yes, of course I checked. I downloaded all the videos in the existing k600 path files, but found the held-out test missing. And then I also tried to crawl them from youtube directly, but found more than 15% removed officially. I believe this ratio will increase as time goes by