What is the original paper of ViT(T) and ViT(S)? In my opinion, this is unclear both in the code and in your paper.
Is it from [1]?
Thank you.
[1] Hugo Touvron, Matthieu Cord, Matthijs Douze, Francisco Massa, Alexandre Sablayrolles, and Hervé Jégou.
Training data-efficient image transformers & distillation through attention. arXiv:2012.12877, 2020.
Hi, thank you for your nice paper.
What is the original paper of ViT(T) and ViT(S)? In my opinion, this is unclear both in the code and in your paper. Is it from [1]?
Thank you.
[1] Hugo Touvron, Matthieu Cord, Matthijs Douze, Francisco Massa, Alexandre Sablayrolles, and Hervé Jégou. Training data-efficient image transformers & distillation through attention. arXiv:2012.12877, 2020.