search

GX77 / Dual-Stream-Transformer-for-Generic-Event-Boundary-Captioning

5 stars 0 forks source link

readme

Dual Stream Transformer for Generic Event Boundary Captioning

Prerequisites

  1. Clone this repository
git clone https://github.com/GX77/Dual-Stream-Transformer-for-Generic-Event-Boundary-Captioning.git

  1. Download Kinetic-GEBC Dataset

  2. Install dependencies

​ Python 3.7、PyTorch 1.1.0

Training and Inference

  1. Training
python3 train.py \
--dset_name kin \
--data_dir ${data_dir} \
--video_feature_dir ${v_feat_dir} \
--region_feature_dir ${r_feat_dir} \
--region_number ${r_n} \
--word2idx_path ${word2idx_path} \
  1. Inference 
python3 translate.py

Others

This code used resources from the following projects: Transformers, Mart