Hello. I was going through the attention implementation and had a question about the operation by the einsum function.
I am not very familiar with the Einstein summation convention and I believe that there are many others like myself.
I would be very grateful if explanations about the operation were added as comments.
As it is, I find it difficult to understand which parts correspond to what in the paper.
Many thanks if you could help me out.
Hello. I was going through the attention implementation and had a question about the operation by the einsum function. I am not very familiar with the Einstein summation convention and I believe that there are many others like myself. I would be very grateful if explanations about the operation were added as comments. As it is, I find it difficult to understand which parts correspond to what in the paper. Many thanks if you could help me out.