What is x_k?
In doc2, X is inputs, the key elements are X W^k, so.. in your paper, the x_k is the k-th element of X W^k?
What is z_q
In doc2, X is inputs, the query elements are X W^q, so.. in your paper, the z_q is the q-th element of X W^q?
or the z_q is the q-th element of the "object query" (which is the input of the decoder) ??
Hi, I'm trying to compare the notion of your paper and the article (let's called it doc2) http://jalammar.github.io/illustrated-transformer/
Would you plz clearify:
What is x_k? In doc2, X is inputs, the key elements are X W^k, so.. in your paper, the x_k is the k-th element of X W^k?
What is z_q In doc2, X is inputs, the query elements are X W^q, so.. in your paper, the z_q is the q-th element of X W^q? or the z_q is the q-th element of the "object query" (which is the input of the decoder) ??