search

tensorflow / nmt

TensorFlow Neural Machine Translation Tutorial
Apache License 2.0
6.38k stars 1.96k forks source link

Unable to match the last equations from the nmt paper in the nmt implementation #271

Open burglarhobbit opened 6 years ago

burglarhobbit commented 6 years ago

In the NMT paper, pg 13-14, they've defined the model architecture. In the Decoder section (A 2.2), they've proposed probability of a target word w.r.t the deep output (ti~) with a single maxout hidden layer.

But if I look at the source code where the graph is built, it calls the _build_decoder function where the decoder section is built, I could not find the implementation of these equations:

image

Can someone clarify as to how those equations are included in the nmt implementation?

tatianashp commented 6 years ago

@ebrevdo - Could you take a look at this?