search

slwang9353 / MobileFormer

MobileFormer in torch
66 stars 13 forks source link

ReLU6 #9

Open wsy-yjys opened 1 year ago

wsy-yjys commented 1 year ago

hello，why you use ReLU6 instead ReLU in the code？

wsy-yjys commented 1 year ago

another question is that

self.shortcut = nn.Sequential().cuda() …… return unproject + self.shortcut(x)

the shortcut connection why need to via the nn.Sequential()？