search

tatp22 / linformer-pytorch

My take on a practical implementation of Linformer for Pytorch.
https://arxiv.org/pdf/2006.04768.pdf
MIT License
403 stars 36 forks source link

Added masking #12

Closed tatp22 closed 4 years ago

tatp22 commented 4 years ago

Note: The masking is not done in the same way as the original Transformer, check out the README or issue 11 for more info.