issues
search
lucidrains
/
perceiver-ar-pytorch
Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch
MIT License
86
stars
4
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Shifting labels to enable learning next token prediction
#10
LiorZ
opened
1 year ago
1
fixing a typo
#9
LiorZ
closed
1 year ago
1
RoPE + Learnable PE vs RoPE only
#8
tomasff
closed
10 months ago
0
how can i implement learned query version ?
#7
pjw971022
opened
1 year ago
0
Why do we add empty dimension here?
#6
inspirit
closed
1 year ago
1
Cross attention should be over the whole seq and smaller seq
#5
kashif
closed
1 year ago
2
Decoding ?
#4
ArEnSc
closed
1 year ago
1
About music generation with perceiver-ar model
#3
feizc
opened
2 years ago
6
Way to relax constrain for prefix length
#2
inspirit
opened
2 years ago
6
some potential helpers
#1
kashif
opened
2 years ago
3