search

IntelLabs / Model-Compression-Research-Package

A library for researching neural networks compression and acceleration methods.
Apache License 2.0
136 stars 24 forks source link

Sparse models available for download? #15

Closed eldarkurtic closed 2 years ago

eldarkurtic commented 2 years ago

Hello :-)

I found your Prune-Once-For-All paper very interesting and would like to play with the sparse models that it produced. Are you going to open-source them soon?

I have noticed you have open-sourced the sparse-pretrained models, but I couldn't find the corresponding models finetuned on downstream tasks (SQuAD, MNLI, QQP, etc.).

ofirzaf commented 2 years ago

We have open sourced some sparse models fine-tuned for SQuAD, available here: https://huggingface.co/Intel/bert-base-uncased-squadv1.1-sparse-80-1x4-block-pruneofa https://huggingface.co/Intel/bert-large-uncased-squadv1.1-sparse-80-1x4-block-pruneofa

It is also possible to create these models yourself using our model-compression-research-package without too much hassle.

Let me know if you can't find what you are looking for

eldarkurtic commented 2 years ago

Okay, thanks a lot for pointers.