pbloem former issues - Githubissues

pbloem / former

Simple transformer implementation from scratch in pytorch.

http://peterbloem.nl/blog/transformers

MIT License

1.03k stars 170 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

How to tokenize a testing phrase

#37 edgarmg91 opened 9 months ago
0
Why the use of log_softmax ?

#36 dsantiago closed 7 months ago
1
No Field in torchtext.data

#35 dtdo90 opened 10 months ago
0
Calculation of memory required in "Going big"

#34 oleksandrasaskia closed 1 year ago
2
Dev ajay

#33 ajay-usfca closed 1 year ago
0
Benntuecon/issue2

#32 benntuecon closed 1 year ago
0
Version1 able to extract

#31 benntuecon closed 1 year ago
0
Question about k × hk weight matrices

#30 ramesaliyev closed 7 months ago
1
improve performance in deeper network using your multi head attention code

#29 fatemehniknezhad closed 1 year ago
3
Hi,question about sliced-up version self-attention

#28 Faith-Uchiha opened 2 years ago
1
conda installation failed

#27 bsun0802 closed 2 years ago
1
Blog is down

#26 JJGO closed 2 years ago
1
Module import error

#25 Cybernetic1 opened 2 years ago
1
ImportError: attempted relative import with no known parent package

#24 RubenRidderstrom closed 3 years ago
8
Understanding multiheaded attention.

#23 anorak94 closed 2 years ago
0
High compute time, what is a reasonable generator model to get somewhat good results to play with?

#22 jplasser closed 3 years ago
1
import SelfAttentionWide (2x) -> import SelfAttentionNarrow, SelfAtte…

#21 bquast closed 3 years ago
1
data.Field no longer supported in torchtext

#20 jvdburgt closed 3 years ago
1
slide 50, v and q mixed up

#19 ulf1 closed 3 years ago
1
token_embedding for non-text sequences

#18 StolkArjen closed 3 years ago
6
Weight matrix dimensions after transofrmation

#17 SrinjaySarkar closed 3 years ago
1
Update __init__.py

#16 SubhashPadala closed 3 years ago
0
How can we visualize the self-attention map

#15 amiltonwong closed 4 years ago
1
Using the trained model

#14 ShivanshuPurohit closed 4 years ago
1
Is narrow attention implemented correctly?

#13 TheGrayFrost closed 3 years ago
8
Accuracies on the examples

#12 sf-wind opened 4 years ago
1
Question about the tool used to make the figures in the blog post

#11 yassouali opened 4 years ago
2
Issue with masking

#10 mc-robinson closed 4 years ago
1
ModuleNotFoundError: No module named 'past'

#9 jjong2ya closed 3 years ago
5
Comparing SelfAttention classes

#8 sidneyaraujomelo closed 4 years ago
2
AttributeError: module 'torch' has no attribute 'triu_indices'

#7 xxxxyan closed 4 years ago
5
Masking done for the upper or lower triangle?

#6 esvhd closed 5 years ago
1
Why is dividing by e**(1/4) for both keys and queries more memory efficient?

#5 esvhd opened 5 years ago
4
Einsum to avoid transpose and reshape

#4 azzever closed 5 years ago
3
add conda env

#3 koen-dejonghe closed 5 years ago
1
Weight scaling should be for keys not values?

#2 esvhd closed 5 years ago
2
ModuleNotFoundError: No module named 'past'

#1 koen-dejonghe closed 3 years ago
7