how to understand has_cls_token？

w1oves / Rein

[CVPR 2024] Official implement of <Stronger, Fewer, & Superior: Harnessing Vision Foundation Models for Domain Generalized Semantic Segmentation>

https://zxwei.site/rein

GNU General Public License v3.0

250 stars 21 forks source link

how to understand has_cls_token？ #44

Closed IronmanVsThanos closed 2 months ago

IronmanVsThanos commented 4 months ago

nice work，and i wanna know how to understand “has_cls_token”？

w1oves commented 4 months ago

For a foundation model, if the first token in the token sequence is a cls_token (commonly used in classification tasks), we set has_cls_token to True; otherwise, we set it to False.