about v-v attention

[Henry0528]

so you changed both q and k to v in openclip/transformer.py class Attention for v-v attention, is there any other modification to the original code of openclip?

[hq-deng]

We keep the original q-k-v path, but we extract v-v attention from each layer and aggregate them.