leaderj1001 Stand-Alone-Self-Attention issues

leaderj1001 / Stand-Alone-Self-Attention

Implementing Stand-Alone Self-Attention in Vision Models using Pytorch

MIT License

457 stars 85 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Stand alone self attention combine with CycleGAN

#26 Jingtianci opened 3 years ago
0
A question about relative position embeddings

#25 787629504 opened 3 years ago
1
Add `sum(dim=2)` for dot-product

#24 jnhwkim closed 3 years ago
1
Has anyone tried changing the batch size

#23 sammens opened 3 years ago
1
Can anyone train resnet50 successfully without NaN

#22 ksouvik52 opened 4 years ago
3
Excessive Memory Usage

#21 digantamisra98 opened 4 years ago
14
Error loading pretrained model

#20 ylee1123 closed 4 years ago
1
Problems about groups

#19 liqi0126 opened 4 years ago
4
Add ResNet101 and ResNet152

#18 quaertym opened 4 years ago
0
Adapting Attention Conv & Stem for a stride > 1

#17 yassouali opened 4 years ago
0
matrix multiplication instead of scalar dot product

#16 vainaixr opened 4 years ago
4
Train with IMAGENET

#15 fityanul closed 3 years ago
3
how about replacing einsum with normal multiplication

#14 tntjd7545 opened 4 years ago
0
Question about einsum.

#13 veritas9872 closed 1 year ago
0
Does not work when out_channels is not even

#12 ifeherva opened 4 years ago
0
problem with unfold

#11 vainaixr opened 4 years ago
1
The wrong imp of the inner-product operation

#10 XiaLiPKU opened 4 years ago
3
Is the 89% acc reported in the readme consisitent with the paper?

#9 zhaoguangxiang opened 4 years ago
1
How to calculate the relative positional embeddings from a row offset and column offset?

#8 songkq opened 4 years ago
3
v_out = torch.cat((v_out_h + self.rel_h, v_out_w + self.rel_w), dim=1)

#7 scutzck033 opened 4 years ago
2
Large memory consumption

#6 skmhrk1209 closed 4 years ago
2
Loss is NaN

#5 phongnhhn92 opened 4 years ago
2
How can you v_out_h + self.rel_h

#4 yt605155624 opened 4 years ago
1
2d embedding

#3 r1ckya closed 4 years ago
1
rel_w and rel_h parameters

#2 ruslangrimov closed 5 years ago
1
Create LICENSE

#1 leaderj1001 closed 5 years ago
0