search

catherinesyeh / attention-viz

Visualizing query-key interactions in language + vision transformers
http://attentionviz.com/
MIT License
122 stars 15 forks source link

Visualize value vectors too? #31

Open catherinesyeh opened 1 year ago

catherinesyeh commented 1 year ago

Could plot value vectors too for each attention head... would definitely add to computational load though.

catherinesyeh commented 1 year ago