search

tatp22 / linformer-pytorch

My take on a practical implementation of Linformer for Pytorch.
https://arxiv.org/pdf/2006.04768.pdf
MIT License
400 stars 36 forks source link

Will any pretrained linformer models be open sourced? #1

Closed pchankh closed 4 years ago

pchankh commented 4 years ago

Great paper! Will be great to have access to existing pretrained multilingual linformer model. Is there any plan to release pretrained linformer models?

tatp22 commented 4 years ago

Hi @pchankh! Unfortunately, I am not the author of the paper, nor do I have access to the hardware necessary for this task, so unfortunately, I cannot provide any pretrained models as of yet.