TimZaman / dotaclient

distributed RL spaghetti al arabiata
26 stars 7 forks source link

Transformers vs LTSM & CNN/RNN for Attention #43

Open Nostrademous opened 5 years ago

Nostrademous commented 5 years ago

https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf

Nostrademous commented 5 years ago

Interesting implementation here: http://nlp.seas.harvard.edu/2018/04/03/attention.html