search

namedtensor / notation

108 stars 5 forks source link

Attention(Q, K, V) eqn's identical? #70

Closed JulianSMoore closed 2 years ago

JulianSMoore commented 2 years ago

The equations in s1 and s3.1.3 look identical but are claimed to be different. (?) Or should "This equation is slightly different from the one in the introduction" read "This next equation..."?

davidweichiang commented 2 years ago

Thanks!