Open yuboona opened 4 years ago
score = v * tanh(W * [hidden; encoder_outputs])
score = v * relu(W * [hidden; encoder_outputs])
Is there some trick here? or this is a result after experimental comparision.
1、Attention's formula
2、question
Is there some trick here? or this is a result after experimental comparision.