Neural Machine Translation by Jointly Learning to Align and Translate (2014, Cited by 11477) - Githubissues

kiccho1101 / paper

Interesting Papers, Articles, and Github repositories.

7 stars 0 forks source link

Neural Machine Translation by Jointly Learning to Align and Translate (2014, Cited by 11477) #10

Open kiccho1101 opened 4 years ago

kiccho1101 commented 4 years ago

https://arxiv.org/abs/1409.0473

The paper that introduces the additive attention

kiccho1101 commented 4 years ago

Conventional Encoder-Decoder

Given input sequence,
The hidden state is calculated as,
and, Maximize the conditional probability,

kiccho1101 commented 4 years ago

Proposed Encoder-Decoder

Define the conditional probability as: