search

catherinesyeh / attention-viz

Visualizing query-key interactions in language + vision transformers
http://attentionviz.com/
MIT License
122 stars 15 forks source link

Add correlation info to plots #42

Open catherinesyeh opened 1 year ago

catherinesyeh commented 1 year ago

E.g., show correlation b/t q-k distance + dot product in single view (and as part of tooltip in matrix view?)

Alternatively (or in addition): show cosine similarity scores, difference between norms, etc.?