Hello, thanks for your attractive idea in this paper.
In the paper, the dimension of each token feature is H and the dimension of each embedding in codebook is N.
Is H equal to N?
Because in eq.2 we need to calculate the distance between these two vectors, the dimension should be same.
Looking forward to your reply!
Hello, thanks for your attractive idea in this paper. In the paper, the dimension of each token feature is H and the dimension of each embedding in codebook is N. Is H equal to N? Because in eq.2 we need to calculate the distance between these two vectors, the dimension should be same. Looking forward to your reply!