CLS token in pretrained model

facebookresearch / mvit

Code Release for MViTv2 on Image Recognition.

Apache License 2.0

372 stars 43 forks source link

CLS token in pretrained model #7

Open vateye opened 2 years ago

vateye commented 2 years ago

Hi, I have noticed CLS token is still existed in the provided ckpt. But in the appendix, it said that class token is not utilized for training? So I am confused about this. Did the cls token in provided ckpt be trained or just randomly initialized?