Closed Ostaijen closed 1 year ago
Modify the ViT base class to return the attention matrix per block along with the features, under a new key block_{i}_attn.
ViT
block_{i}_attn
Modify the
ViTbase class to return the attention matrix per block along with the features, under a new keyblock_{i}_attn.