search

SydCaption / SAAT

MIT License
62 stars 21 forks source link

How to train with SCST? #26

Closed Andrew-Zhu closed 3 years ago

Andrew-Zhu commented 3 years ago

Hi, you have mentioned in the paper that

Using reinforcement learning (SCST [43]), our model achieves the best result in terms of CIDEr and ranks second on the rest metrics.

and you train the model with

_make -f Makefile_msrvtt_svo train GID=0 EXP_NAME=xe FEATS="irv2 c3d category" BFEATS="roi_feat roi_box" USE_RL=0 CST=0 USE_MIXER=0 SCB_CAPTIONS=0 LOGLEVEL=DEBUG MAXEPOCH=100 LAMBDA=20

Could you provide the training script for the RL training? Thanks a lot !!

SydCaption commented 3 years ago

Hi, it should be

make -f Makefile_msrvtt_svo train GID=0 EXP_NAME=scst FEATS="irv2 c3d category" BFEATS="roi_feat roi_box"  USE_RL=1 USE_CST=0 SCB_CAPTIONS=0 USE_MIXER=1 MIXER_FROM=1 USE_EOS=1 LOGLEVEL=DEBUG MAX_EPOCHS=100 START_FROM=path/of/pretrained
Andrew-Zhu commented 3 years ago

Thanks for your quick reply !