issues
search
junxnone
/
aiwiki
AI Wiki
https://junxnone.github.io/aiwiki
18
stars
2
forks
source link
ML Attention Luong
#211
Open
junxnone
opened
4 years ago
junxnone
commented
4 years ago
Luong Attention
Reference
paper - 2014 - Neural Machine Translation by Jointly Learning to Align and Translate
paper - 2015 - Effective Approaches to Attention-based Neural Machine Translation
BahdanauAttention与LuongAttention注意力机制简介
一文看懂 Bahdanau 和 Luong 两种 Attention 机制的区别
Brief
Name
Pipeline
公式
Global Attention
Local Attention
Alignment Model
Bahdanau Attention vs Luong Attention
Name
Description
score
Bahdanau Attention
paper
h(t-1) -> a(t)
Luong Attention
paper
h(t) -> a(t)
junxnone
commented
4 years ago
junxnone/aiwiki#210
Luong Attention
Reference
Brief
Alignment Model
Bahdanau Attention vs Luong Attention