happyharrycn / actionformer_release

Code release for ActionFormer (ECCV 2022)
MIT License
419 stars 77 forks source link

ActivityNet trainning json file #57

Closed houzhijian closed 1 year ago

houzhijian commented 1 year ago

Dear authors,

     I have a quick question about the ActivityNet training JSON file. 

     Your released file "anet1.3_tsp_filtered.json" contains the annotation of 9987 videos out of the total 10024 training videos. I wonder why the annotations of the missing videos are filtered. How will the performance be impacted if further adding those missing training samples?

    Thanks for your reply.
tzzcl commented 1 year ago

Hi, we are not intended to miss these videos. The ActivityNet dataset only releases the Youtube URL for the video. Thus some videos will become unavailable on Youtube. Increasing the number of training videos will somehow impact the performance, but I think the impact is minor since we only miss around 1% videos.

houzhijian commented 1 year ago

Hi, Chen-Lin Zhang,

  Thanks for your quick response! : )

  I still have a further issue. I think the invalid Youtube URL should not be a problem because the current framework is based on offline features.

  Your released data may already contain the TSP features for the full video because the total feature file number is 14950 (10024 training + 4926 validation = 14950).   

 Because of the above statistic, I am puzzled about the reason why the annotations of the missing videos are filtered.

 Looking forward to your reply ; )
happyharrycn commented 1 year ago

These videos are filtered if (1) they don’t have TSP features (or the length of TSP features does not match the video duration); or (2) they don’t have any actions that last longer than 0.01 seconds.

houzhijian commented 1 year ago

Thanks for the clarity.