search

berniwal / swin-transformer-pytorch

Implementation of the Swin Transformer in PyTorch.
https://arxiv.org/pdf/2103.14030.pdf
MIT License
794 stars 129 forks source link

some questions for FeedForward #17

Open 2324773711 opened 3 years ago

2324773711 commented 3 years ago

why the mlp_dim = hidden_dimension *4