facebookresearch / AVT

Code release for ICCV 2021 paper "Anticipative Video Transformer"
Apache License 2.0
152 stars 28 forks source link

Use RULSTM feature #34

Closed sanketsans closed 2 years ago

sanketsans commented 2 years ago

Hi, I am trying to use rulstm as the backbone, but not sure which expts is required for it.

Anirudh257 commented 2 years ago

I think only these experiments: https://github.com/facebookresearch/AVT/blob/main/expts/06_ek100_avt_tsnflow.txt and https://github.com/facebookresearch/AVT/blob/main/expts/06_ek100_avt_tsnflow.txt use rulstm features.

rohitgirdhar commented 2 years ago

I don't use RULSTM as the backbone, however I do have experiments with TSN as the backbone (which is what RULSTM uses as a backbone too). All the files in expts/ that have a _tsn in the name are the ones that have that backbone. Those configs would have +dataset_train.reader_fn={_target_: datasets.epic_kitchens.EpicRULSTMFeatsReader, ... in it, which specifies where it will read the data from.