tsujuifu / pytorch_violet

A PyTorch implementation of VIOLET
137 stars 6 forks source link

Some metadata files are missing #16

Closed cmh1027 closed 1 year ago

cmh1027 commented 1 year ago

Hello, where can I get missing metadata files like txt_msvd-retrieval.json, args_msrvtt-qa.json, or args_msvd-retrieval.json, etc? Should I make those by myself? In addition, how can I evaluate qa? It seems only evaluation code for retrieval is provided

tsujuifu commented 1 year ago

Hi, we did not do text-to-video retrieval on the MSVD dataset. The args for each dataset are similar to the template in _data. You can edit it for your own needs. main_qamc.py and main_qamc.py also include the validation/testing process. You can replace path_ckpt as your trained checkpoint to do the evaluation.

cmh1027 commented 1 year ago

Thank you!