search

microsoft / Swin-Transformer

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".
https://arxiv.org/abs/2103.14030
MIT License
13.96k stars 2.06k forks source link

Is each token (to-embedding) value an integer? #355

Open guotong1988 opened 6 months ago

guotong1988 commented 6 months ago

Is each token (before-embedding) value an integer?

In practice, where is this done?

The code self.head = nn.Linear(self.num_features, num_classes) seems not output integers?

Thank you very much!