Transformer

[shanmo]

• https://zhuanlan.zhihu.com/p/411311520
• https://uvadlc-notebooks.readthedocs.io/en/latest/tutorial_notebooks/tutorial6/Transformers_and_MHAttention.html
• https://data-science-blog.com/blog/2021/05/10/constructing-transformer-model-little-by-little/
• https://towardsdatascience.com/a-detailed-guide-to-pytorchs-nn-transformer-module-c80afbc9ffb1
• https://github.com/greentfrapp/attention-primer
• https://github.com/gordicaleksa/pytorch-original-transformer

[shanmo]

• https://ifwind.github.io/2021/08/31/Transformer-BERT-%E5%AE%9E%E6%88%98/
• https://www.bilibili.com/video/BV1Wv411h7kN?p=49&vd_source=08e7803d6baa596a0719c10c06f22612
  • https://www.youtube.com/watch?v=n9TlOhRjYoc&ab_channel=Hung-yiLee
  • https://www.youtube.com/watch?v=hYdO9CscNes&ab_channel=Hung-yiLee

[shanmo]

• SEGTREE TRANSFORMER: ITERATIVE REFINEMENT OF HIERARCHICAL FEATURES

• 转载 | Transformer的七十二变 - 李军毅的文章 - 知乎 https://zhuanlan.zhihu.com/p/134139608