search

idiap / fast-transformers

Pytorch library for fast transformer implementations
1.65k stars 179 forks source link

Feature request: L2 self-attention #60

Open ketyi opened 3 years ago

ketyi commented 3 years ago

Hi Fellows,

Excellent work you've done here. Would it be possible to have the L2 self-attention https://arxiv.org/abs/2006.04710 as well?

Many thanks