About Cls_cvt.py - Githubissues

microsoft / CvT

This is an official implementation of CvT: Introducing Convolutions to Vision Transformers.

MIT License

533 stars 120 forks source link

Open diaodeyi opened 2 years ago

diaodeyi commented 2 years ago

I want to konw why there isn't any to the function get_cls_model and compute_macs

diaodeyi commented 2 years ago

By the way the self.proj = nn.Linear(dim_out, dim_out) Means FFN only projection with same dimension?

sauravgarg540 commented 2 years ago

By the way the self.proj = nn.Linear(dim_out, dim_out) Means FFN only projection with same dimension?

Yes, it is a part of the attention mechanism.