iLovEing / notebook

MIT License
0 stars 0 forks source link

Transformer #18

Open iLovEing opened 1 year ago

iLovEing commented 1 year ago
iLovEing commented 1 year ago

self-attention

计算相关性得到单个输出

image image


矩阵形式

image image image

iLovEing commented 1 year ago

transformer

image


encoder

image


decoder

image


联结

image


训练

image


变形

image image image image image