yitu-opensource / T2T-ViT

ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
Other
1.14k stars 177 forks source link

Benefit of DropPath #61

Open askerlee opened 3 years ago

askerlee commented 3 years ago

Thank you for this wonderful work! May I know what's the benefit of using DropPath during training? Have you done any ablation study?