is there a priority between drop out and patch norm?

SwinTransformer / Video-Swin-Transformer

This is an official implementation for "Video Swin Transformers".

https://arxiv.org/abs/2106.13230

Apache License 2.0

1.42k stars 199 forks source link

Open emergencyd opened 2 years ago

emergencyd commented 2 years ago

I've noticed that defaul setting is patch_norm=False, drop_path_rate=0.2. Will this be better than patch_norm=True, drop_path_rate=0?

Thank you!