Does it support Marian machine translation models?

princeton-nlp / CoFiPruning

[ACL 2022] Structured Pruning Learns Compact and Accurate Models https://arxiv.org/abs/2204.00408

MIT License

192 stars 31 forks source link

Does it support Marian machine translation models? #50

Open Khaled-Elsaka opened 1 year ago

Khaled-Elsaka commented 1 year ago

I am trying to prune MarianMT model for example https://huggingface.co/Helsinki-NLP/opus-mt-en-ar. and the library seems not to support it. Is there any way to use it for pruning that model, or what parts of the code should I modify to make it compatible?

xiamengzhou commented 1 year ago

Hi this model seems to be a seq2seq model, and you can learn a set of masks to put on both the encoder and decoder side of the model for pruning.