Muzammal-Naseer / IPViT

Official repository for "Intriguing Properties of Vision Transformers" (NeurIPS 2021--Spotlight)
176 stars 19 forks source link

Amazing work, but can it work on DETR? #10

Open 1184125805 opened 2 years ago

1184125805 commented 2 years ago

ViT family show strong robustness on RandomDrop and Domain shift Problem. The thing is , I 'm working on object detection these days,detr is an end to end object detection methods which adopted Transformer's encoder decoder part, but the backbone I use , is Resnet50, it can still find the properties that your paper mentioned. Above all I want to ask two questions: (1).Do these intriguing properties come from encoder、decoder part? (2).What's the difference between distribution shift and domain shift(I saw distribution shift first time on your paper)?