issues
search
catherinesyeh
/
attention-viz
Visualizing query-key interactions in language + vision transformers
http://attentionviz.com/
MIT License
122
stars
15
forks
source link
Add GPT visualizations
#29
Closed
catherinesyeh
closed
1 year ago
catherinesyeh
commented
1 year ago
[x] rerun code to generate umap/tsne coordinates for GPT
[x] 2d
[x] 3d
[x] recompute other info (e.g., attention)
[x] add to attention-viz
catherinesyeh
commented
1 year ago
[x] should there be option to switch between gpt & bert?
if yes, should we pre-compute everything, or just load when user decides to switch between them?