search

LeeYN-43 / Clover

Offical PyTorch implementation of Clover: Towards A Unified Video-Language Alignment and Fusion Model (CVPR2023)
Apache License 2.0
40 stars 4 forks source link

How to get the .pkl file? #3

Open DHUAVY opened 1 year ago

DHUAVY commented 1 year ago

Hi, I want to train the model using the MSR-VTT dataset. And it tells me that I need a pkl file but I can only find the mp4 and txt files. So how can I tranfer them to or maybe to find the pkl file.

LeeYN-43 commented 1 year ago

Hi, sorry for the late reply. You need to construct the pkl file based on the annotation data of MSRVTT-1kA dataset on your own. The pkl file format is a list of dictionaries [{}, {}, {}], where each dictionary represents the annotation information for a video. It includes two keys, 'filename' and 'text'. 'filename' is the real path of the video, and 'text' is the corresponding text. Hope this can help you :)