idiap / fast-transformers

Pytorch library for fast transformer implementations
1.65k stars 179 forks source link

Provenance of algorithms #126

Open taibai123abc opened 1 year ago

taibai123abc commented 1 year ago

There are many attentions in the project, but only two articles were specified. Can you clarify which articles the different ATTENTION mechanisms are from?