search

SwinTransformer / Video-Swin-Transformer

This is an official implementation for "Video Swin Transformers".
https://arxiv.org/abs/2106.13230
Apache License 2.0
1.42k stars 199 forks source link

Drop path rate #10

Closed minostauros closed 3 years ago

minostauros commented 3 years ago

Hi,

https://github.com/SwinTransformer/Video-Swin-Transformer/blob/db018fb8896251711791386bbd2127562fd8d6a6/configs/recognition/swin/swin_small_patch244_window877_kinetics400_1k.py#L4

Code claims Swin small uses 0.1 drop path rate, but does it match with the report which reads 0.2? Swin-T and Swin-B uses 0.1, and 0.3 respectively as follows:

https://github.com/SwinTransformer/Video-Swin-Transformer/blob/db018fb8896251711791386bbd2127562fd8d6a6/configs/recognition/swin/swin_tiny_patch244_window877_kinetics400_1k.py#L4 https://github.com/SwinTransformer/Video-Swin-Transformer/blob/db018fb8896251711791386bbd2127562fd8d6a6/configs/recognition/swin/swin_base_patch244_window877_kinetics400_1k.py#L4

Thanks,

hust-nj commented 3 years ago

Hi, drop path rate of small model is 0.1, just a clerical error in paper, we will update it in next version.