search

yangbang18 / CARE

(TIP'2023) Concept-Aware Video Captioning: Describing Videos with Effective Prior Information
22 stars 0 forks source link

Reproducing the notebooks #2

Closed tzubad closed 1 month ago

tzubad commented 1 month ago

While trying to run 'VATEX_qualitative_examples', I've encountered this error:

FileNotFoundError: [Errno 2] No such file or directory: 'c:/Users/User/Desktop/Video2Desc/CARE/exps/VATEX/Transformer/Base/median_ViT_ami/best.ckpt'

This makes sense since folder 'exps' doesn't exist in this repository. How can I reproduce that folder?

yangbang18 commented 1 month ago

Hi, to run notebooks/VATEX_qualitative_examples.ipynb, you should first conduct experiments (i.e., train models) on the VATEX dataset.

For example, to obtain exps/VATEX/Transformer/Base/median_ViT_ami/best.ckpt, you can run the following command:

base_cmd="python train.py \
--dataset VATEX \
--method Transformer \
--VATEX_I3D_preds_json ./data/VATEX_I3D_preds.json"

cmd="$base_cmd --task Base --arch median --feats ViT --modality ami"
bash scripts/run.sh "$cmd" $num_runs $gpu

Note: Please ensure that you have downloaded VATEX pre-processed data following README_DATA.md.

More details can refer to scripts/exp_main_VATEX.sh.

tzubad commented 1 month ago

Thank you for the explanation, I'll try that!