Based on Table 4 (Cross-Modal Attention Statistics) in your article, you are reporting the % of tokens for which at least 1 of the top-5 attended tokens belongs to the other modality for each head of the transformers: T1, T2, T3, T4. I have this question:
Are you reporting the % of tokens for each frame, and then you are doing in average of the % for the total number of frames ? Or does this % presented in Table 4 represents only a sample from one frame ?
Hi,
Based on Table 4 (Cross-Modal Attention Statistics) in your article, you are reporting the % of tokens for which at least 1 of the top-5 attended tokens belongs to the other modality for each head of the transformers: T1, T2, T3, T4. I have this question: Are you reporting the % of tokens for each frame, and then you are doing in average of the % for the total number of frames ? Or does this % presented in Table 4 represents only a sample from one frame ?