mx-mark / VideoTransformer-pytorch

PyTorch implementation of a collections of scalable Video Transformer Benchmarks.
267 stars 34 forks source link

How to place kinetics400 dataset? #18

Open yanmingchao2 opened 2 years ago

yanmingchao2 commented 2 years ago

Sorry to bother you again. How to correctly place the prepared kinetics400 dataset when pretrain according to usage (vivit).

errors are reported as follows:

115 M Trainable params 0 Non-trainable params 115 M Total params 460.218 Total estimated model params size (MB) Validation sanity check: 0%| | 0/2 [00:00<?, ?it/s][14:18:20] /github/workspace/src/video/video_reader.cc:83: ERROR opening: abseiling/BiKRPPjAzvw.mp4, No such file or directory Error reading abseiling/BiKRPPjAzvw.mp4... [14:18:20] /github/workspace/src/video/video_reader.cc:83: ERROR opening: hammer_throw/AYcsAYm3Pic.mp4, No such file or directory Error reading hammer_throw/AYcsAYm3Pic.mp4... [14:18:20] /github/workspace/src/video/video_reader.cc:83: ERROR opening: making_sushi/OZepG6XiLPU.mp4, No such file or directory Error reading making_sushi/OZepG6XiLPU.mp4... [14:18:20] /github/workspace/src/video/video_reader.cc:83: ERROR opening: holding_snake/iqXrMJdfD6Q.mp4, No such file or directory Error reading holding_snake/iqXrMJdfD6Q.mp4... [14:18:20] /github/workspace/src/video/video_reader.cc:83: ERROR opening: blowing_nose/W1rplwHQoxI.mp4, No such file or directory Error reading blowing_nose/W1rplwHQoxI.mp4...

[14:34:25] 14:34:25/github/workspace/src/video/video_reader.cc] :/github/workspace/src/video/video_reader.ccError reading cutting_pineapple/TnZIN3rfyIc.mp4... Error reading snorkeling/yAiqzcM2UCo.mp4... 83:: 83ERROR opening: : catching_or_throwing_baseball/F7hs_aIqsbk.mp4ERROR opening: , planting_trees/D5--ZGEjiWI.mp4No such file or directory, No such file or directory Error reading catching_or_throwing_baseball/F7hs_aIqsbk.mp4... Error reading planting_trees/D5--ZGEjiWI.mp4... [14:34:25] /github/workspace/src/video/video_reader.cc:83: ERROR opening: [cooking_egg/WIWuMqN_SV0.mp4, No such file or directory14:34:25[ ] 14:34:25/github/workspace/src/video/video_reader.cc] :/github/workspace/src/video/video_reader.ccError reading cooking_egg/WIWuMqN_SV0.mp4... 83[:: 8314:34:25ERROR opening: : ] ERROR opening: motorcycling/y3ld8SrteSM.mp4/github/workspace/src/video/video_reader.ccshining_shoes/6VLda6SPjwQ.mp4, :, 83No such file or directoryNo such file or directory:

ERROR opening: ripping_paper/DOAwyFz2Y0I.mp4, No such file or directory Error reading shining_shoes/6VLda6SPjwQ.mp4... Error reading motorcycling/y3ld8SrteSM.mp4... Error reading ripping_paper/DOAwyFz2Y0I.mp4... [14:34:25] /github/workspace/src/video/video_reader.cc:83: ERROR opening: disc_golfing/5ueYObM1DOY.mp4, No such file or directory [Error reading disc_golfing/5ueYObM1DOY.mp4... 14:34:25] /github/workspace/src/video/video_reader.cc:83: ERROR opening: shining_shoes/4F3HxPIT91o.mp4, No such file or directory [14:34:25] [Error reading shining_shoes/4F3HxPIT91o.mp4... /github/workspace/src/video/video_reader.cc:8314:34:25: ] ERROR opening: /github/workspace/src/video/video_reader.ccbrushing_hair/6JO9EwAZ7Y0.mp4:, 83No such file or directory: ERROR opening: shearing_sheep/sSTHZHHp-_c.mp4, [No such file or directoryError reading brushing_hair/6JO9EwAZ7Y0.mp4...

yanmingchao2 commented 2 years ago

thank you very much!

mx-mark commented 2 years ago

@yanmingchao2 you can follow this guide to prepare the kinetics dataset https://github.com/open-mmlab/mmaction2/blob/master/tools/data/kinetics/README.md

asif-hanif commented 1 year ago

Hi @mx-mark Could you provide the link which you used to prepare Kinetics400 dataset. Could you also provide the format of annotation file being used for pre-training of ViViT on Kinetics-400

balajiiitg commented 1 year ago

Hi I need to prepare kinetics-400 dataset fro ViViT training could you please help in preparing data