Thanks very much for your interesting work! I have a question about the O(N) space complexity mentioned in your paper. I am wondering whether you can help me to figure it out.
In Eq. (11) of your paper, you compute QK^T in the denominator, which may lead to O(N^2*d) space complexity?
Thanks very much for your interesting work! I have a question about the O(N) space complexity mentioned in your paper. I am wondering whether you can help me to figure it out.
In Eq. (11) of your paper, you compute QK^T in the denominator, which may lead to O(N^2*d) space complexity?
bests