Open catherinesyeh opened 1 year ago
Create a "projection of projections" (similar to fig. 6 in What Does Bert Look At?) to help users discover attention heads that may have similar attention patterns. Could be an alternate global view of attention (more clusters than matrix).
Create a "projection of projections" (similar to fig. 6 in What Does Bert Look At?) to help users discover attention heads that may have similar attention patterns. Could be an alternate global view of attention (more clusters than matrix).