xyzforever / BEVT

PyTorch implementation of BEVT (CVPR 2022) https://arxiv.org/abs/2112.01529
Apache License 2.0
157 stars 19 forks source link

About ImageNet1k checkpoint #1

Closed happy-hsy closed 2 years ago

happy-hsy commented 2 years ago

Hi. Thanks for this nice work. But I have some confusion in Image Sup, Image CL, BEVT-I and BEVT experiments. In these experiments, are you using the pretrain checkpoint or the finetune(after self-supervised learning pretrain) checkpoint?

cddlyf commented 2 years ago

@happy-lifi , here we use the pretrained model from image supervised pretraining, image contrastive learning, BEVT-image only pretraining and BEVT pretraining as the initialization and report the finetuning results on corresponding video datasets.