Separius / awesome-fast-attention

list of efficient attention modules
GNU General Public License v3.0
990 stars 108 forks source link

Add the ProbSparse Attention (Informer) #2

Closed zhouhaoyi closed 3 years ago

zhouhaoyi commented 3 years ago

I have the ProbSparse self-attention from the ''Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting" paper https://arxiv.org/abs/2012.07436. We have built a repo as the official implement here https://github.com/zhouhaoyi/Informer2020. Thank you a lot!