A repositsory of common methods, datasets, and tasks for video research
Please note that this repository is in the process of being released to the public. Please bear with us as we standardize the API and streamline the code.
Some of the baselines were run with an older version of the codebase (but the git commit hash is available for each experiment) and might need to be updated.
We encourage you to submit a Pull Request to help us document and incorporate as many baselines and datasets as possible to this codebase
We hope this project will be of value to the community and everyone will consider adding their methods to this codebase
List of implemented methods:
List of supported datasets:
List of supported tasks:
Contributor: Gunnar Atli Sigurdsson
@inproceedings{sigurdsson2018pyvideoresearch,
author = {Gunnar A. Sigurdsson and Abhinav Gupta},
title = {PyVideoResearch},
year={2018},
code = {https://github.com/gsig/PyVideoResearch},
}
and remember to cite the papers for the datasets/methods you use.
Requirements:
Python packages:
See external libraries under external/ for requirements if using their corresponding baselines.
Run the following to get both this repository and the remote repositories under external/
git clone git@github.com:gsig/PyVideoResearch.git
git submodule update --init --recursive
Good luck!
We are in the process of preparing and releasing the pre-trained models. If anything is missing, please let us know. The names correspond to experiments under "baseline_exp". While we standardize the names, please be aware that some of the model may have names listed after "original name" in the experiment file. We also provide the generated log.txt file for each experiment as name.txt
The models are stored here: https://www.dropbox.com/sh/duodxydolzz5qfl/AAC0i70lv8ssVRWg4ux5Vv9pa?dl=0
ResNet50 pre-trained on Charades
ResNet1010 pre-trained on Charades
I3D pre-trained on ImageNet+Kinetics (courtesy of https://github.com/piergiaj)
I3D pre-trained on Charades (courtesy of https://github.com/piergiaj)
actor_observer_3d_charades_ego.py
actor_observer_charades_ego.py
actor_observer_classification_charades_ego.py
async_tf_i3d_charades.py
i3d_ava.py
i3d_mask_rcnn_ava.py
i3d_something_something.py
inpainting.py
nonlocal_resnet50_3d_charades.py
nonlocal_resnet50_3d_kinetics.py
resnet50_3d_charades.py
resnet50_3d_kinetics.py
temporal_relational_networks_charades.py
temporal_relational_networks_something_something.py
temporal_segment_networks_activity_net.py
temporal_segment_networks_charades.py
two_stream_kinetics.py
two_stream_networks_activity_net.py