search

tatp22 / linformer-pytorch

My take on a practical implementation of Linformer for Pytorch.
https://arxiv.org/pdf/2006.04768.pdf
MIT License
400 stars 36 forks source link

Got rid of unneccessary activation #18

Closed tatp22 closed 3 years ago

tatp22 commented 3 years ago

There was an useless activation, that actually didn't belong in the model. I got rid of it