Closed nanmehta closed 2 years ago
Can you please help me out with how we can find the correlation maps? I am not getting it.
The softmax(QK) is an HW x HW feature map, we select a point in the first HW (the red point in the figure) and can draw a HW heatmap about the point.
Can you please help me out with how we can find the correlation maps? I am not getting it.