Provide convenient and efficient feature extraction tool for users

moabitcoin / ig65m-pytorch

PyTorch 3D video classification models pre-trained on 65 million Instagram videos

MIT License

265 stars 30 forks source link

Provide convenient and efficient feature extraction tool for users #6

Closed daniel-j-h closed 5 years ago

daniel-j-h commented 5 years ago

Right now our extract.py tool can extract features for a single video at a time, and parallelizes the data loading across ranges of frames. We should change that:

Extract features for a dataset of videos / directory of videos
Dump features into file keyed by e.g. frame ids
Allow extracting by means of PyTorch hooks for arbitrary activations
Parallelize on video level not range of frames per video