issues
search
pbloem
/
former
Simple transformer implementation from scratch in pytorch.
http://peterbloem.nl/blog/transformers
MIT License
1.03k
stars
170
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
How to tokenize a testing phrase
#37
edgarmg91
opened
9 months ago
0
Why the use of log_softmax ?
#36
dsantiago
closed
7 months ago
1
No Field in torchtext.data
#35
dtdo90
opened
10 months ago
0
Calculation of memory required in "Going big"
#34
oleksandrasaskia
closed
1 year ago
2
Dev ajay
#33
ajay-usfca
closed
1 year ago
0
Benntuecon/issue2
#32
benntuecon
closed
1 year ago
0
Version1 able to extract
#31
benntuecon
closed
1 year ago
0
Question about k × hk weight matrices
#30
ramesaliyev
closed
7 months ago
1
improve performance in deeper network using your multi head attention code
#29
fatemehniknezhad
closed
1 year ago
3
Hi,question about sliced-up version self-attention
#28
Faith-Uchiha
opened
2 years ago
1
conda installation failed
#27
bsun0802
closed
2 years ago
1
Blog is down
#26
JJGO
closed
2 years ago
1
Module import error
#25
Cybernetic1
opened
2 years ago
1
ImportError: attempted relative import with no known parent package
#24
RubenRidderstrom
closed
3 years ago
8
Understanding multiheaded attention.
#23
anorak94
closed
2 years ago
0
High compute time, what is a reasonable generator model to get somewhat good results to play with?
#22
jplasser
closed
3 years ago
1
import SelfAttentionWide (2x) -> import SelfAttentionNarrow, SelfAtte…
#21
bquast
closed
3 years ago
1
data.Field no longer supported in torchtext
#20
jvdburgt
closed
3 years ago
1
slide 50, v and q mixed up
#19
ulf1
closed
3 years ago
1
token_embedding for non-text sequences
#18
StolkArjen
closed
3 years ago
6
Weight matrix dimensions after transofrmation
#17
SrinjaySarkar
closed
3 years ago
1
Update __init__.py
#16
SubhashPadala
closed
3 years ago
0
How can we visualize the self-attention map
#15
amiltonwong
closed
4 years ago
1
Using the trained model
#14
ShivanshuPurohit
closed
4 years ago
1
Is narrow attention implemented correctly?
#13
TheGrayFrost
closed
3 years ago
8
Accuracies on the examples
#12
sf-wind
opened
4 years ago
1
Question about the tool used to make the figures in the blog post
#11
yassouali
opened
4 years ago
2
Issue with masking
#10
mc-robinson
closed
4 years ago
1
ModuleNotFoundError: No module named 'past'
#9
jjong2ya
closed
3 years ago
5
Comparing SelfAttention classes
#8
sidneyaraujomelo
closed
4 years ago
2
AttributeError: module 'torch' has no attribute 'triu_indices'
#7
xxxxyan
closed
4 years ago
5
Masking done for the upper or lower triangle?
#6
esvhd
closed
5 years ago
1
Why is dividing by e**(1/4) for both keys and queries more memory efficient?
#5
esvhd
opened
5 years ago
4
Einsum to avoid transpose and reshape
#4
azzever
closed
5 years ago
3
add conda env
#3
koen-dejonghe
closed
5 years ago
1
Weight scaling should be for keys not values?
#2
esvhd
closed
5 years ago
2
ModuleNotFoundError: No module named 'past'
#1
koen-dejonghe
closed
3 years ago
7