About SENet module in the middle of patchembed layer

jiaowoguanren0615 / EfficientViT-Pytorch

This is a warehouse for EfficientViT-pytorch-model, can be used to train your dataset

MIT License

4 stars 2 forks source link

Open XcloudFance opened 2 months ago

XcloudFance commented 2 months ago

I havent seen any part of the paper mentioned about it. But the source code contains SENet in patchembed layers.

Regarding of my concerns, are those results shown in the paper also benefited from Channel Attention? Are the model parameters also involving SENet?

XcloudFance commented 2 months ago

Sorry, it is in patchmerging layer, not patchembed layer