catherinesyeh / attention-viz

Visualizing query-key interactions in language + vision transformers
http://attentionviz.com/
MIT License
122 stars 15 forks source link

Aggregate attention visualizations #47

Closed catherinesyeh closed 1 year ago

catherinesyeh commented 1 year ago

Add aggregate attention visualizations for each head (e.g., try heatmap / Jesse Vig bipartite graphs)

Note: right now, probably mostly for single view, but potentially could add to matrix view too maybe?

catherinesyeh commented 1 year ago

done!