search

idiap / fast-transformers

Pytorch library for fast transformer implementations
1.65k stars 179 forks source link

Performer integration request #40

Closed ketyi closed 4 years ago

ketyi commented 4 years ago

Hello All,

First, you have an excellent work here.

Don't you want to integrate https://github.com/google-research/google-research/tree/master/performer/fast_self_attention into it?

angeloskath commented 4 years ago

Thanks for the good words!

Yes I will integrate it shortly. You can check the progress in issue #38 .

If you don't mind I will be closing this issue as a duplicate of #38. Feel free to reopen it or open another one if you have further questions/suggestions.

ketyi commented 4 years ago

Yes, sorry for the duplicate.