junxnone / tio

Log

Other

10 stars 5 forks source link

Transformer - Performer #925

Open junxnone opened 3 years ago

junxnone commented 3 years ago

Reference

2020-09 [Performer] Rethinking Attention with Performers [paper] [Code]
自己挖坑自己填，谷歌大改Transformer注意力，速度、内存利用率都提上去了

Brief

junxnone commented 3 years ago

756