issues
search
uclaacmai
/
text-decoder
MIT License
1
stars
0
forks
source link
Attention Transformer
#9
Open
leonlenk
opened
1 month ago
leonlenk
commented
1 month ago
Create a transformer with only attention (no dense layers)
Discuss depth of model and the limitations
This notebook should also go over how layernorm works
You can use what has been previously created (embeddings, utils, attention)