xmu-xiaoma666 / External-Attention-pytorch

🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐
MIT License
11.4k stars 1.93k forks source link

请问下mobileVIT实现代码里是relu 原文说的是swish 这里是有意为之吗 #36

Closed fakerhbj closed 3 years ago

xmu-xiaoma666 commented 3 years ago

已修改