junxnone / tio

Log

Other

10 stars 5 forks source link

Nystromformer: A Nystrom-based Algorithm for Approximating Self-Attention #935

Open junxnone opened 3 years ago

junxnone commented 3 years ago

Reference

2021-02 [Nyströmformer] A Nyström-Based Algorithm for Approximating Self-Attention [Paper] [Code]

Brief

Nystrom approximation
Motivation
背景/存在的问题
做了什么尝试/分别有什么效果
应用领域

Arch

Evaluation

Tricks